2024.12.16 09:42:19.153194 [ 580 ] {} Context: Server was built in debug mode. It will work slowly. 2024.12.16 09:42:19.154121 [ 580 ] {} Context: ThreadFuzzer is enabled. Application will run slowly and unstable. 2024.12.16 09:42:19.628346 [ 580 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2024.12.16 09:42:19.651379 [ 580 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2024.12.16 09:42:19.667015 [ 580 ] {} Application: Integrity check of the executable skipped because the reference checksum could not be read. 2024.12.16 09:42:25.417898 [ 580 ] {} CloudPlacementInfo: Placement info has not been loaded 2024.12.16 09:42:28.368988 [ 580 ] {} KeeperLogStore: No logs exists in /var/lib/clickhouse/coordination/logs. It's Ok if it's the first run of clickhouse-keeper. 2024.12.16 09:42:28.372706 [ 580 ] {} KeeperLogStore: Removing all changelogs 2024.12.16 09:42:28.386531 [ 580 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2024.12.16 09:42:28.445034 [ 580 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2024.12.16 09:42:28.445798 [ 580 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2024.12.16 09:42:28.506640 [ 1202 ] {} RaftInstance: Election timeout, initiate leader election 2024.12.16 09:42:30.421986 [ 580 ] {} Access(local_directory): File /var/lib/clickhouse/access/users.list doesn't exist 2024.12.16 09:42:30.422765 [ 580 ] {} Access(local_directory): Recovering lists in directory /var/lib/clickhouse/access/ 2024.12.16 09:42:33.479499 [ 580 ] {} Context: Table system.session_log is enabled. It's unreliable and may contain garbage. Do not use it for any kind of security monitoring. 2024.12.16 09:44:10.847016 [ 1389 ] {} ZooKeeperClient: Code: 33. DB::Exception: Cannot read all data. Bytes read: 0. Bytes expected: 4. (CANNOT_READ_ALL_DATA), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, unsigned long&, String&&) @ 0x000000000afd304c 6. /build/src/IO/ReadBuffer.h:199: DB::ReadBuffer::readStrict(char*, unsigned long) @ 0x000000000afd2e6f 7. /build/src/IO/ReadHelpers.h:118: void DB::readPODBinary(int&, DB::ReadBuffer&) @ 0x00000000133868e2 8. /build/src/IO/ReadHelpers.h:1303: void DB::readBinary(int&, DB::ReadBuffer&) @ 0x000000001338689d 9. /build/src/IO/ReadHelpers.h:1340: void DB::readBinaryEndian<(std::endian)64206, int>(int&, DB::ReadBuffer&) @ 0x000000001d41cd3d 10. /build/src/IO/ReadHelpers.h:1353: void DB::readBinaryBigEndian(int&, DB::ReadBuffer&) @ 0x000000001d41ccfd 11. /build/src/Common/ZooKeeper/ZooKeeperIO.h:51: void Coordination::read(int&, DB::ReadBuffer&) @ 0x000000001d41743d 12. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:289: void Coordination::ZooKeeper::read(int&) @ 0x000000001e2523ed 13. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:807: Coordination::ZooKeeper::receiveEvent() @ 0x000000001e24778c 14. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:773: Coordination::ZooKeeper::receiveThread() @ 0x000000001e2471d9 15. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:398: Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_1::operator()() const @ 0x000000001e24d698 16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001e24d675 17. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_1&, std::tuple<>&>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_1&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e24d659 18. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_1&, std::tuple<>&>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_1&, std::tuple<>&) @ 0x000000001e24d5bd 19. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_1>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_1&&)::'lambda'()::operator()() @ 0x000000001e24d4e5 20. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001e24d455 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001e24d435 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001e24d415 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001e24d3e0 24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 26. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 27. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 29. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 30. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 31. ? @ 0x00007f003424eac3 (version 24.3.12.76.altinitystable) 2024.12.16 09:44:11.224463 [ 1378 ] {} ZooKeeperClient: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:59102 -> [::1]:9181). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:169: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000134e8a44 7. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 8. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:303: Coordination::ZooKeeper::flushWriteBuffer() @ 0x000000001e23d7fd 9. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:707: Coordination::ZooKeeper::sendThread() @ 0x000000001e246469 10. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:397: Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_0::operator()() const @ 0x000000001e24ce58 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001e24ce35 12. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_0&, std::tuple<>&>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e24ce19 13. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_0&, std::tuple<>&>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_0&, std::tuple<>&) @ 0x000000001e24cd7d 14. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_0>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_0&&)::'lambda'()::operator()() @ 0x000000001e24cca5 15. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001e24cc15 16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001e24cbf5 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001e24cbd5 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001e24cba0 19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 21. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 22. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 24. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 25. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 26. ? @ 0x00007f003424eac3 27. ? @ 0x00007f00342e0850 (version 24.3.12.76.altinitystable) 2024.12.16 09:44:11.474106 [ 1389 ] {} ZooKeeperClient: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a09d07 4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0de47 5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022894827 6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a416b 7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x00000000228a2b09 8. /build/base/poco/Net/src/SocketImpl.cpp:272: Poco::Net::SocketImpl::shutdown() @ 0x00000000228a5532 9. /build/base/poco/Net/src/StreamSocket.cpp:109: Poco::Net::StreamSocket::shutdown() @ 0x00000000228a925e 10. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:1032: Coordination::ZooKeeper::finalize(bool, bool, String const&) @ 0x000000001e23e4e9 11. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:795: Coordination::ZooKeeper::receiveThread() @ 0x000000001e2475df 12. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:398: Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_1::operator()() const @ 0x000000001e24d698 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001e24d675 14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_1&, std::tuple<>&>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_1&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e24d659 15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_1&, std::tuple<>&>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_1&, std::tuple<>&) @ 0x000000001e24d5bd 16. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_1>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_1&&)::'lambda'()::operator()() @ 0x000000001e24d4e5 17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001e24d455 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001e24d435 19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001e24d415 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001e24d3e0 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 23. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 24. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 28. ? @ 0x00007f003424eac3 29. ? @ 0x00007f00342e0850 (version 24.3.12.76.altinitystable) 2024.12.16 09:44:12.247821 [ 583 ] {140825d6-67b7-4107-b5f4-772d97d51420} InterpreterCreateQuery: ATTACH TABLE query with full table definition is not recommended: use either ATTACH TABLE hits_v1; to attach existing table or CREATE TABLE hits_v1 ; to create new table or ATTACH TABLE hits_v1 FROM '/path/to/data/'
; to create new table and attach data. 2024.12.16 09:44:24.547752 [ 583 ] {a71eed55-4444-42f1-b41a-a42e2aa4b39d} InterpreterCreateQuery: ATTACH TABLE query with full table definition is not recommended: use either ATTACH TABLE visits_v1; to attach existing table or CREATE TABLE visits_v1
; to create new table or ATTACH TABLE visits_v1 FROM '/path/to/data/'
; to create new table and attach data. 2024.12.16 09:45:00.763842 [ 1189 ] {} RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled 2024.12.16 09:45:07.420836 [ 1455 ] {} Context: Server was built in debug mode. It will work slowly. 2024.12.16 09:45:07.423257 [ 1455 ] {} Context: ThreadFuzzer is enabled. Application will run slowly and unstable. 2024.12.16 09:45:07.791174 [ 1455 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2024.12.16 09:45:07.798632 [ 1455 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2024.12.16 09:45:07.799407 [ 1455 ] {} Application: Integrity check of the executable skipped because the reference checksum could not be read. 2024.12.16 09:45:12.556950 [ 1455 ] {} CloudPlacementInfo: Placement info has not been loaded 2024.12.16 09:45:16.162807 [ 1455 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2024.12.16 09:45:16.352263 [ 1455 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2024.12.16 09:45:16.391002 [ 1455 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2024.12.16 09:45:16.595034 [ 2068 ] {} RaftInstance: Election timeout, initiate leader election 2024.12.16 09:45:30.202448 [ 1455 ] {} Context: Table system.session_log is enabled. It's unreliable and may contain garbage. Do not use it for any kind of security monitoring. 2024.12.16 09:47:22.671727 [ 2154 ] {} ZooKeeperClient: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::1]:9181). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x00000000134e6f2c 6. /build/src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x00000000134e60a0 7. /build/src/IO/ReadBuffer.h:70: DB::ReadBuffer::next() @ 0x000000000af5ec6a 8. /build/src/IO/ReadBuffer.h:106: DB::CompressedReadBufferBase::readCompressedData(unsigned long&, unsigned long&, bool) @ 0x0000000019dd9d92 9. /build/src/Compression/CompressedReadBuffer.cpp:12: DB::CompressedReadBuffer::nextImpl() @ 0x0000000019dd9883 10. /build/src/IO/ReadBuffer.h:70: DB::ReadBuffer::next() @ 0x000000000af5ec6a 11. /build/src/IO/ReadBuffer.h:106: DB::ReadBuffer::read(char*, unsigned long) @ 0x000000000af5ea13 12. /build/src/IO/ReadBuffer.h:197: DB::ReadBuffer::readStrict(char*, unsigned long) @ 0x000000000afd2de8 13. /build/src/IO/ReadHelpers.h:118: void DB::readPODBinary(int&, DB::ReadBuffer&) @ 0x00000000133868e2 14. /build/src/IO/ReadHelpers.h:1303: void DB::readBinary(int&, DB::ReadBuffer&) @ 0x000000001338689d 15. /build/src/IO/ReadHelpers.h:1340: void DB::readBinaryEndian<(std::endian)64206, int>(int&, DB::ReadBuffer&) @ 0x000000001d41cd3d 16. /build/src/IO/ReadHelpers.h:1353: void DB::readBinaryBigEndian(int&, DB::ReadBuffer&) @ 0x000000001d41ccfd 17. /build/src/Common/ZooKeeper/ZooKeeperIO.h:51: void Coordination::read(int&, DB::ReadBuffer&) @ 0x000000001d41743d 18. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:289: void Coordination::ZooKeeper::read(int&) @ 0x000000001e2523ed 19. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:807: Coordination::ZooKeeper::receiveEvent() @ 0x000000001e24778c 20. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:773: Coordination::ZooKeeper::receiveThread() @ 0x000000001e2471d9 21. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:398: Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_1::operator()() const @ 0x000000001e24d698 22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001e24d675 23. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_1&, std::tuple<>&>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_1&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e24d659 24. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_1&, std::tuple<>&>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_1&, std::tuple<>&) @ 0x000000001e24d5bd 25. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_1>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_1&&)::'lambda'()::operator()() @ 0x000000001e24d4e5 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001e24d455 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001e24d435 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001e24d415 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001e24d3e0 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 (version 24.3.12.76.altinitystable) 2024.12.16 09:47:23.008678 [ 2239 ] {} ZooKeeperClient: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:34120 -> [::1]:9181). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:169: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000134e8a44 7. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 8. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:303: Coordination::ZooKeeper::flushWriteBuffer() @ 0x000000001e23d7fd 9. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:707: Coordination::ZooKeeper::sendThread() @ 0x000000001e246469 10. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:397: Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_0::operator()() const @ 0x000000001e24ce58 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001e24ce35 12. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_0&, std::tuple<>&>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e24ce19 13. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_0&, std::tuple<>&>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_0&, std::tuple<>&) @ 0x000000001e24cd7d 14. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_0>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_0&&)::'lambda'()::operator()() @ 0x000000001e24cca5 15. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001e24cc15 16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001e24cbf5 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001e24cbd5 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001e24cba0 19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 21. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 22. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 24. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 25. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 26. ? @ 0x00007f74023baac3 27. ? @ 0x00007f740244c850 (version 24.3.12.76.altinitystable) 2024.12.16 09:47:23.348379 [ 2154 ] {} ZooKeeperClient: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a09d07 4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0de47 5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022894827 6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a416b 7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x00000000228a2b09 8. /build/base/poco/Net/src/SocketImpl.cpp:272: Poco::Net::SocketImpl::shutdown() @ 0x00000000228a5532 9. /build/base/poco/Net/src/StreamSocket.cpp:109: Poco::Net::StreamSocket::shutdown() @ 0x00000000228a925e 10. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:1032: Coordination::ZooKeeper::finalize(bool, bool, String const&) @ 0x000000001e23e4e9 11. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:795: Coordination::ZooKeeper::receiveThread() @ 0x000000001e2475df 12. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:398: Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_1::operator()() const @ 0x000000001e24d698 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001e24d675 14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_1&, std::tuple<>&>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_1&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e24d659 15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_1&, std::tuple<>&>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_1&, std::tuple<>&) @ 0x000000001e24d5bd 16. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_1>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_1&&)::'lambda'()::operator()() @ 0x000000001e24d4e5 17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001e24d455 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001e24d435 19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001e24d415 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001e24d3e0 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 23. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 24. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 28. ? @ 0x00007f74023baac3 29. ? @ 0x00007f740244c850 (version 24.3.12.76.altinitystable) 2024.12.16 09:52:15.292345 [ 2093 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {3035f09f-9767-4f79-a76a-3926d52c39f7::202412_1_46_9}: Code: 241. DB::Exception: Memory tracker (for thread): fault injected (at specific point). (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, char const*&&) @ 0x00000000132eab6c 6. /build/src/Common/MemoryTracker.cpp:184: MemoryTracker::injectFault() const @ 0x00000000132e7f5f 7. /build/src/Common/CurrentMemoryTracker.cpp:129: CurrentMemoryTracker::injectFault() @ 0x0000000013256b05 8. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:149: DB::MergePlainMergeTreeTask::finish() @ 0x000000001d13f918 9. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:71: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13f076 10. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x000000001cba15ed 11. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x000000001cba210e 12. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef, StrongTypedef, std::basic_string_view>)::'lambda'()::operator()() const @ 0x000000001cba9c78 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba9c55 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001cba9c35 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001cba9c15 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001cba9bdd 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 (version 24.3.12.76.altinitystable) 2024.12.16 09:58:54.534996 [ 2099 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {fe54ed48-ddd9-4cf8-aa3b-418c81cf437c::202412_1_176_35}: Code: 241. DB::Exception: Memory tracker (for thread): fault injected (at specific point). (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, char const*&&) @ 0x00000000132eab6c 6. /build/src/Common/MemoryTracker.cpp:184: MemoryTracker::injectFault() const @ 0x00000000132e7f5f 7. /build/src/Common/CurrentMemoryTracker.cpp:129: CurrentMemoryTracker::injectFault() @ 0x0000000013256b05 8. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:149: DB::MergePlainMergeTreeTask::finish() @ 0x000000001d13f918 9. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:71: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13f076 10. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x000000001cba15ed 11. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x000000001cba210e 12. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef, StrongTypedef, std::basic_string_view>)::'lambda'()::operator()() const @ 0x000000001cba9c78 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba9c55 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001cba9c35 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001cba9c15 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001cba9bdd 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 (version 24.3.12.76.altinitystable) 2024.12.16 09:59:15.809188 [ 2091 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {fe54ed48-ddd9-4cf8-aa3b-418c81cf437c::202412_1_181_36}: Code: 241. DB::Exception: Memory tracker (for thread): fault injected (at specific point). (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, char const*&&) @ 0x00000000132eab6c 6. /build/src/Common/MemoryTracker.cpp:184: MemoryTracker::injectFault() const @ 0x00000000132e7f5f 7. /build/src/Common/CurrentMemoryTracker.cpp:129: CurrentMemoryTracker::injectFault() @ 0x0000000013256b05 8. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:149: DB::MergePlainMergeTreeTask::finish() @ 0x000000001d13f918 9. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:71: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13f076 10. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x000000001cba15ed 11. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x000000001cba210e 12. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef, StrongTypedef, std::basic_string_view>)::'lambda'()::operator()() const @ 0x000000001cba9c78 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba9c55 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001cba9c35 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001cba9c15 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001cba9bdd 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 (version 24.3.12.76.altinitystable) 2024.12.16 10:08:18.266812 [ 2093 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {3fad45aa-c6fd-41ee-8fe5-5d48f1e42f6c::202412_1_127_57}: Code: 241. DB::Exception: Memory tracker (for thread): fault injected (at specific point). (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, char const*&&) @ 0x00000000132eab6c 6. /build/src/Common/MemoryTracker.cpp:184: MemoryTracker::injectFault() const @ 0x00000000132e7f5f 7. /build/src/Common/CurrentMemoryTracker.cpp:129: CurrentMemoryTracker::injectFault() @ 0x0000000013256b05 8. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:149: DB::MergePlainMergeTreeTask::finish() @ 0x000000001d13f918 9. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:71: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13f076 10. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x000000001cba15ed 11. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x000000001cba210e 12. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef, StrongTypedef, std::basic_string_view>)::'lambda'()::operator()() const @ 0x000000001cba9c78 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba9c55 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001cba9c35 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001cba9c15 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001cba9bdd 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 (version 24.3.12.76.altinitystable) 2024.12.16 10:21:40.545682 [ 2096 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {3fad45aa-c6fd-41ee-8fe5-5d48f1e42f6c::202412_1_232_107}: Code: 241. DB::Exception: Memory tracker (for thread): fault injected (at specific point). (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, char const*&&) @ 0x00000000132eab6c 6. /build/src/Common/MemoryTracker.cpp:184: MemoryTracker::injectFault() const @ 0x00000000132e7f5f 7. /build/src/Common/CurrentMemoryTracker.cpp:129: CurrentMemoryTracker::injectFault() @ 0x0000000013256b05 8. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:149: DB::MergePlainMergeTreeTask::finish() @ 0x000000001d13f918 9. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:71: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13f076 10. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x000000001cba15ed 11. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x000000001cba210e 12. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef, StrongTypedef, std::basic_string_view>)::'lambda'()::operator()() const @ 0x000000001cba9c78 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba9c55 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001cba9c35 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001cba9c15 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001cba9bdd 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 (version 24.3.12.76.altinitystable) 2024.12.16 10:23:42.898985 [ 2100 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {bdb3abf1-bb86-44b8-a138-7f8c6b07475d::202412_1_283_94}: Code: 241. DB::Exception: Memory tracker (for thread): fault injected (at specific point). (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, char const*&&) @ 0x00000000132eab6c 6. /build/src/Common/MemoryTracker.cpp:184: MemoryTracker::injectFault() const @ 0x00000000132e7f5f 7. /build/src/Common/CurrentMemoryTracker.cpp:129: CurrentMemoryTracker::injectFault() @ 0x0000000013256b05 8. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:149: DB::MergePlainMergeTreeTask::finish() @ 0x000000001d13f918 9. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:71: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13f076 10. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x000000001cba15ed 11. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x000000001cba210e 12. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef, StrongTypedef, std::basic_string_view>)::'lambda'()::operator()() const @ 0x000000001cba9c78 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba9c55 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001cba9c35 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001cba9c15 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001cba9bdd 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 (version 24.3.12.76.altinitystable) 2024.12.16 10:25:20.931701 [ 2096 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {fe54ed48-ddd9-4cf8-aa3b-418c81cf437c::202412_1_541_267}: Code: 241. DB::Exception: Memory tracker (for thread): fault injected (at specific point). (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, char const*&&) @ 0x00000000132eab6c 6. /build/src/Common/MemoryTracker.cpp:184: MemoryTracker::injectFault() const @ 0x00000000132e7f5f 7. /build/src/Common/CurrentMemoryTracker.cpp:129: CurrentMemoryTracker::injectFault() @ 0x0000000013256b05 8. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:149: DB::MergePlainMergeTreeTask::finish() @ 0x000000001d13f918 9. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:71: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13f076 10. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x000000001cba15ed 11. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x000000001cba210e 12. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef, StrongTypedef, std::basic_string_view>)::'lambda'()::operator()() const @ 0x000000001cba9c78 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba9c55 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001cba9c35 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001cba9c15 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001cba9bdd 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 (version 24.3.12.76.altinitystable) 2024.12.16 10:25:25.830156 [ 2100 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {fe54ed48-ddd9-4cf8-aa3b-418c81cf437c::202412_1_542_268}: Code: 241. DB::Exception: Memory tracker (for thread): fault injected (at specific point). (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, char const*&&) @ 0x00000000132eab6c 6. /build/src/Common/MemoryTracker.cpp:184: MemoryTracker::injectFault() const @ 0x00000000132e7f5f 7. /build/src/Common/CurrentMemoryTracker.cpp:129: CurrentMemoryTracker::injectFault() @ 0x0000000013256b05 8. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:149: DB::MergePlainMergeTreeTask::finish() @ 0x000000001d13f918 9. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:71: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13f076 10. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x000000001cba15ed 11. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x000000001cba210e 12. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef, StrongTypedef, std::basic_string_view>)::'lambda'()::operator()() const @ 0x000000001cba9c78 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba9c55 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001cba9c35 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001cba9c15 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001cba9bdd 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 (version 24.3.12.76.altinitystable) 2024.12.16 10:26:04.087894 [ 2091 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {fe54ed48-ddd9-4cf8-aa3b-418c81cf437c::202412_1_551_277}: Code: 241. DB::Exception: Memory tracker (for thread): fault injected (at specific point). (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, char const*&&) @ 0x00000000132eab6c 6. /build/src/Common/MemoryTracker.cpp:184: MemoryTracker::injectFault() const @ 0x00000000132e7f5f 7. /build/src/Common/CurrentMemoryTracker.cpp:129: CurrentMemoryTracker::injectFault() @ 0x0000000013256b05 8. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:149: DB::MergePlainMergeTreeTask::finish() @ 0x000000001d13f918 9. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:71: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13f076 10. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x000000001cba15ed 11. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x000000001cba210e 12. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef, StrongTypedef, std::basic_string_view>)::'lambda'()::operator()() const @ 0x000000001cba9c78 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba9c55 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001cba9c35 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001cba9c15 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001cba9bdd 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 (version 24.3.12.76.altinitystable) 2024.12.16 10:28:53.225373 [ 2096 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {3fad45aa-c6fd-41ee-8fe5-5d48f1e42f6c::202412_1_283_131}: Code: 241. DB::Exception: Memory tracker (for thread): fault injected (at specific point). (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, char const*&&) @ 0x00000000132eab6c 6. /build/src/Common/MemoryTracker.cpp:184: MemoryTracker::injectFault() const @ 0x00000000132e7f5f 7. /build/src/Common/CurrentMemoryTracker.cpp:129: CurrentMemoryTracker::injectFault() @ 0x0000000013256b05 8. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:149: DB::MergePlainMergeTreeTask::finish() @ 0x000000001d13f918 9. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:71: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13f076 10. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x000000001cba15ed 11. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x000000001cba210e 12. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef, StrongTypedef, std::basic_string_view>)::'lambda'()::operator()() const @ 0x000000001cba9c78 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba9c55 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001cba9c35 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001cba9c15 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001cba9bdd 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 (version 24.3.12.76.altinitystable) 2024.12.16 10:30:36.906925 [ 2099 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {bdb3abf1-bb86-44b8-a138-7f8c6b07475d::202412_1_335_131}: Code: 241. DB::Exception: Memory tracker (for thread): fault injected (at specific point). (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, char const*&&) @ 0x00000000132eab6c 6. /build/src/Common/MemoryTracker.cpp:184: MemoryTracker::injectFault() const @ 0x00000000132e7f5f 7. /build/src/Common/CurrentMemoryTracker.cpp:129: CurrentMemoryTracker::injectFault() @ 0x0000000013256b05 8. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:149: DB::MergePlainMergeTreeTask::finish() @ 0x000000001d13f918 9. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:71: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13f076 10. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x000000001cba15ed 11. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x000000001cba210e 12. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef, StrongTypedef, std::basic_string_view>)::'lambda'()::operator()() const @ 0x000000001cba9c78 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba9c55 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001cba9c35 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001cba9c15 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001cba9bdd 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 (version 24.3.12.76.altinitystable) 2024.12.16 10:39:43.168953 [ 2102 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {3fad45aa-c6fd-41ee-8fe5-5d48f1e42f6c::202412_1_367_166}: Code: 241. DB::Exception: Memory tracker (for thread): fault injected (at specific point). (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, char const*&&) @ 0x00000000132eab6c 6. /build/src/Common/MemoryTracker.cpp:184: MemoryTracker::injectFault() const @ 0x00000000132e7f5f 7. /build/src/Common/CurrentMemoryTracker.cpp:129: CurrentMemoryTracker::injectFault() @ 0x0000000013256b05 8. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:149: DB::MergePlainMergeTreeTask::finish() @ 0x000000001d13f918 9. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:71: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13f076 10. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x000000001cba15ed 11. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x000000001cba210e 12. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef, StrongTypedef, std::basic_string_view>)::'lambda'()::operator()() const @ 0x000000001cba9c78 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba9c55 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001cba9c35 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001cba9c15 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001cba9bdd 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 (version 24.3.12.76.altinitystable) 2024.12.16 10:41:23.111228 [ 2087 ] {} CgroupsMemoryUsageObserver: Exceeded soft memory limit (13.77 GiB) 2024.12.16 10:42:08.387507 [ 2087 ] {} CgroupsMemoryUsageObserver: Exceeded soft memory limit (13.77 GiB) 2024.12.16 10:42:17.361396 [ 2094 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {fe54ed48-ddd9-4cf8-aa3b-418c81cf437c::202412_621_779_33}: Code: 241. DB::Exception: Memory tracker (for thread): fault injected (at specific point). (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, char const*&&) @ 0x00000000132eab6c 6. /build/src/Common/MemoryTracker.cpp:184: MemoryTracker::injectFault() const @ 0x00000000132e7f5f 7. /build/src/Common/CurrentMemoryTracker.cpp:129: CurrentMemoryTracker::injectFault() @ 0x0000000013256b05 8. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:149: DB::MergePlainMergeTreeTask::finish() @ 0x000000001d13f918 9. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:71: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13f076 10. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x000000001cba15ed 11. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x000000001cba210e 12. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef, StrongTypedef, std::basic_string_view>)::'lambda'()::operator()() const @ 0x000000001cba9c78 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba9c55 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001cba9c35 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001cba9c15 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001cba9bdd 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 (version 24.3.12.76.altinitystable) 2024.12.16 10:42:23.651793 [ 2087 ] {} CgroupsMemoryUsageObserver: Exceeded hard memory limit (14.54 GiB) 2024.12.16 10:43:38.663118 [ 2087 ] {} CgroupsMemoryUsageObserver: Exceeded soft memory limit (13.77 GiB) 2024.12.16 10:43:53.975257 [ 2087 ] {} CgroupsMemoryUsageObserver: Exceeded hard memory limit (14.54 GiB) 2024.12.16 10:45:39.063041 [ 2087 ] {} CgroupsMemoryUsageObserver: Exceeded hard memory limit (14.54 GiB) 2024.12.16 10:45:39.063727 [ 2087 ] {} CgroupsMemoryUsageObserver: Exceeded soft memory limit (13.77 GiB) 2024.12.16 10:47:39.591747 [ 2087 ] {} CgroupsMemoryUsageObserver: Exceeded soft memory limit (13.77 GiB) 2024.12.16 10:49:43.071125 [ 2753 ] {} Context: Server was built in debug mode. It will work slowly. 2024.12.16 10:49:43.071981 [ 2753 ] {} Context: ThreadFuzzer is enabled. Application will run slowly and unstable. 2024.12.16 10:49:43.476016 [ 2753 ] {} Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production. 2024.12.16 10:49:43.480724 [ 2753 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2024.12.16 10:49:43.489272 [ 2753 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2024.12.16 10:49:43.490019 [ 2753 ] {} Application: Integrity check of the executable skipped because the reference checksum could not be read. 2024.12.16 10:50:00.492317 [ 2753 ] {} CloudPlacementInfo: Placement info has not been loaded 2024.12.16 10:50:03.914066 [ 2753 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2024.12.16 10:50:03.927323 [ 2753 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2024.12.16 10:50:03.927911 [ 2753 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2024.12.16 10:50:04.071260 [ 3450 ] {} RaftInstance: Election timeout, initiate leader election 2024.12.16 10:50:14.828134 [ 2753 ] {} Context: Table system.session_log is enabled. It's unreliable and may contain garbage. Do not use it for any kind of security monitoring. 2024.12.16 10:51:56.410104 [ 3519 ] {} test.visits (41d82839-5472-4425-b891-a2dc2a236577): Removing temporary directory /var/lib/clickhouse/disks/s3_disk/store/41d/41d82839-5472-4425-b891-a2dc2a236577/tmp_merge_201403_1_6_1/ 2024.12.16 10:51:56.411056 [ 3519 ] {} test.visits (41d82839-5472-4425-b891-a2dc2a236577): Since zero-copy replication is enabled we are not going to remove blobs from shared storage for /var/lib/clickhouse/disks/s3_disk/store/41d/41d82839-5472-4425-b891-a2dc2a236577/tmp_merge_201403_1_6_1/ 2024.12.16 10:51:56.826012 [ 3672 ] {} ZooKeeperClient: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::1]:9181). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x00000000134e6f2c 6. /build/src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x00000000134e60a0 7. /build/src/IO/ReadBuffer.h:70: DB::ReadBuffer::next() @ 0x000000000af5ec6a 8. /build/src/IO/ReadBuffer.h:106: DB::ReadBuffer::read(char*, unsigned long) @ 0x000000000af5ea13 9. /build/src/IO/ReadBuffer.h:197: DB::ReadBuffer::readStrict(char*, unsigned long) @ 0x000000000afd2de8 10. /build/src/IO/ReadHelpers.h:118: void DB::readPODBinary(int&, DB::ReadBuffer&) @ 0x00000000133868e2 11. /build/src/IO/ReadHelpers.h:1303: void DB::readBinary(int&, DB::ReadBuffer&) @ 0x000000001338689d 12. /build/src/IO/ReadHelpers.h:1340: void DB::readBinaryEndian<(std::endian)64206, int>(int&, DB::ReadBuffer&) @ 0x000000001d41cd3d 13. /build/src/IO/ReadHelpers.h:1353: void DB::readBinaryBigEndian(int&, DB::ReadBuffer&) @ 0x000000001d41ccfd 14. /build/src/Common/ZooKeeper/ZooKeeperIO.h:51: void Coordination::read(int&, DB::ReadBuffer&) @ 0x000000001d41743d 15. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:289: void Coordination::ZooKeeper::read(int&) @ 0x000000001e2523ed 16. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:807: Coordination::ZooKeeper::receiveEvent() @ 0x000000001e24778c 17. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:773: Coordination::ZooKeeper::receiveThread() @ 0x000000001e2471d9 18. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:398: Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_1::operator()() const @ 0x000000001e24d698 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001e24d675 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_1&, std::tuple<>&>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_1&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e24d659 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_1&, std::tuple<>&>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_1&, std::tuple<>&) @ 0x000000001e24d5bd 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_1>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_1&&)::'lambda'()::operator()() @ 0x000000001e24d4e5 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001e24d455 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001e24d435 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001e24d415 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001e24d3e0 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:51:56.861614 [ 3480 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {41d82839-5472-4425-b891-a2dc2a236577::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=5, jobs=1): (while reading column VisitID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/41d/41d82839-5472-4425-b891-a2dc2a236577/201403_6_6_0/ in table test.visits (41d82839-5472-4425-b891-a2dc2a236577) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 6868): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe(ThreadPoolImpl>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e92e1 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e917b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e9130 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e90f0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e907b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190eadb1 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e8d90 16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future DB::scheduleFromThreadPoolUnsafe(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl>&, String const&, Priority) @ 0x00000000190e861c 17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e7e3f 18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019365312 19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936561e 20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddc44d 21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6d168 22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6cfbd 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6cf7d 24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6cf3d 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6cf08 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd6a7e 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd2efd 28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fd02d6 29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x0000000019fd045c 30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&) @ 0x000000001ce6ab9b 31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce6a910 (version 24.3.12.76.altinitystable) 2024.12.16 10:51:57.066093 [ 3661 ] {} ZooKeeperClient: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:44148 -> [::1]:9181). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:169: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000134e8a44 7. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 8. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:303: Coordination::ZooKeeper::flushWriteBuffer() @ 0x000000001e23d7fd 9. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:707: Coordination::ZooKeeper::sendThread() @ 0x000000001e246469 10. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:397: Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_0::operator()() const @ 0x000000001e24ce58 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001e24ce35 12. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_0&, std::tuple<>&>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e24ce19 13. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_0&, std::tuple<>&>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_0&, std::tuple<>&) @ 0x000000001e24cd7d 14. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_0>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_0&&)::'lambda'()::operator()() @ 0x000000001e24cca5 15. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001e24cc15 16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001e24cbf5 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001e24cbd5 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001e24cba0 19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 21. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 22. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 24. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 25. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 26. ? @ 0x00007f713a222ac3 27. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 10:51:57.264449 [ 3547 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::TransactionsInfoLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=9, jobs=5). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:294: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf3a8b6 21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 (version 24.3.12.76.altinitystable) 2024.12.16 10:51:57.534703 [ 3672 ] {} ZooKeeperClient: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a09d07 4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0de47 5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022894827 6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a416b 7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x00000000228a2b09 8. /build/base/poco/Net/src/SocketImpl.cpp:272: Poco::Net::SocketImpl::shutdown() @ 0x00000000228a5532 9. /build/base/poco/Net/src/StreamSocket.cpp:109: Poco::Net::StreamSocket::shutdown() @ 0x00000000228a925e 10. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:1032: Coordination::ZooKeeper::finalize(bool, bool, String const&) @ 0x000000001e23e4e9 11. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:795: Coordination::ZooKeeper::receiveThread() @ 0x000000001e2475df 12. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:398: Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_1::operator()() const @ 0x000000001e24d698 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001e24d675 14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_1&, std::tuple<>&>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_1&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e24d659 15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_1&, std::tuple<>&>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_1&, std::tuple<>&) @ 0x000000001e24d5bd 16. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_1>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_1&&)::'lambda'()::operator()() @ 0x000000001e24d4e5 17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001e24d455 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001e24d435 19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001e24d415 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001e24d3e0 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 23. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 24. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 28. ? @ 0x00007f713a222ac3 29. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 10:51:57.735160 [ 3551 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::ProcessorProfileLogElement]: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=13, jobs=13). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:310: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf3ab86 21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 (version 24.3.12.76.altinitystable) 2024.12.16 10:51:58.164367 [ 3483 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {41d82839-5472-4425-b891-a2dc2a236577::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=19, jobs=9). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1fc91 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1fb3b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1faf0 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1fab0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1fa3b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce216d1 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1f750 16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future> DB::scheduleFromThreadPoolUnsafe, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl>&, String const&, Priority) @ 0x000000001ce1f09c 17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1d6c3 18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl>*, unsigned long) @ 0x000000001ce1d5b3 19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6eeac 20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, void, void>(std::allocator&, DB::MergeTreeMarksLoader*, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6edb5 21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int>(std::allocator, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6ece3 22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], std::shared_ptr&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, void>(std::allocator const&, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6eb95 23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, void>(std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6e49b 24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&, std::function const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bed3 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bbdd 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bb9d 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bb5d 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bb28 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd6a7e 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd2efd 31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fd02d6 (version 24.3.12.76.altinitystable) 2024.12.16 10:51:59.494870 [ 3731 ] {ade06770-49a6-4694-8f9e-24c30d326b48} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=8, jobs=8). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:44920) (in query: SELECT version(), arrayStringConcat(groupArray(value), ' ') FROM system.build_options WHERE name IN ('GIT_HASH', 'GIT_BRANCH') ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 13. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 14. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 15. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 16. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 17. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 18. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 19. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 20. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 21. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 22. ? @ 0x00007f713a222ac3 23. ? @ 0x00007f713a2b4850 2024.12.16 10:51:59.506046 [ 3731 ] {ade06770-49a6-4694-8f9e-24c30d326b48} DynamicQueryHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=8, jobs=8). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 13. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 14. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 15. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 16. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 17. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 18. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 19. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 20. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 21. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 22. ? @ 0x00007f713a222ac3 23. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 10:51:59.752542 [ 3741 ] {931882c2-177a-412b-a5f1-a72a63073d34} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=1, jobs=1). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:44970) (in query: SELECT version(), arrayStringConcat(groupArray(value), ' ') FROM system.build_options WHERE name IN ('GIT_HASH', 'GIT_BRANCH') ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 13. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 14. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 15. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 16. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 17. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 18. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 19. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 20. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 21. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 22. ? @ 0x00007f713a222ac3 23. ? @ 0x00007f713a2b4850 2024.12.16 10:51:59.873344 [ 3741 ] {931882c2-177a-412b-a5f1-a72a63073d34} DynamicQueryHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=1, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 13. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 14. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 15. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 16. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 17. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 18. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 19. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 20. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 21. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 22. ? @ 0x00007f713a222ac3 23. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 10:52:00.566861 [ 2758 ] {dbbe5f74-a16f-4b0f-8a8e-b9a94ad29bea} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:44990) (in query: SELECT version(), arrayStringConcat(groupArray(value), ' ') FROM system.build_options WHERE name IN ('GIT_HASH', 'GIT_BRANCH') ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 13. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 14. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 15. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 16. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 17. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 18. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 19. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 20. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 21. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 22. ? @ 0x00007f713a222ac3 23. ? @ 0x00007f713a2b4850 2024.12.16 10:52:00.582273 [ 2758 ] {dbbe5f74-a16f-4b0f-8a8e-b9a94ad29bea} DynamicQueryHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 13. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 14. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 15. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 16. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 17. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 18. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 19. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 20. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 21. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 22. ? @ 0x00007f713a222ac3 23. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 10:52:01.180986 [ 2758 ] {d7d99d19-e76d-45ce-8246-65c3721c06df} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=8, jobs=8). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:45062) (in query: SELECT version(), arrayStringConcat(groupArray(value), ' ') FROM system.build_options WHERE name IN ('GIT_HASH', 'GIT_BRANCH') ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 13. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 14. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 15. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 16. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 17. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 18. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 19. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 20. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 21. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 22. ? @ 0x00007f713a222ac3 23. ? @ 0x00007f713a2b4850 2024.12.16 10:52:01.197737 [ 2758 ] {d7d99d19-e76d-45ce-8246-65c3721c06df} DynamicQueryHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=8, jobs=8). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 13. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 14. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 15. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 16. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 17. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 18. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 19. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 20. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 21. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 22. ? @ 0x00007f713a222ac3 23. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 10:52:02.239162 [ 3731 ] {85fa7663-a4fd-48e2-9e1a-330d63759de2} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=6, jobs=6). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:45114) (in query: SELECT version(), arrayStringConcat(groupArray(value), ' ') FROM system.build_options WHERE name IN ('GIT_HASH', 'GIT_BRANCH') ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:52:02.258390 [ 3731 ] {85fa7663-a4fd-48e2-9e1a-330d63759de2} DynamicQueryHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=6, jobs=6). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 (version 24.3.12.76.altinitystable) 2024.12.16 10:52:03.427185 [ 3731 ] {c56bd391-4e2c-4eaa-a937-7b1d9f5f9f2c} executeQuery: Code: 704. DB::Exception: The query result was not cached because the query contains a non-deterministic function. Use setting `query_cache_nondeterministic_function_handling = 'save'` or `= 'ignore'` to cache the query result regardless or to omit caching. (QUERY_CACHE_USED_WITH_NONDETERMINISTIC_FUNCTIONS) (version 24.3.12.76.altinitystable) (from [::1]:45266) (in query: SELECT version(), arrayStringConcat(groupArray(value), ' ') FROM system.build_options WHERE name IN ('GIT_HASH', 'GIT_BRANCH') ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f4eb7 6. /build/src/Interpreters/executeQuery.cpp:1205: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb2845 7. /build/src/Interpreters/executeQuery.cpp:1496: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb4e89 8. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 9. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 10. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 11. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 12. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 13. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 14. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 15. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 16. ? @ 0x00007f713a222ac3 17. ? @ 0x00007f713a2b4850 2024.12.16 10:52:03.460496 [ 3731 ] {c56bd391-4e2c-4eaa-a937-7b1d9f5f9f2c} DynamicQueryHandler: Code: 704. DB::Exception: The query result was not cached because the query contains a non-deterministic function. Use setting `query_cache_nondeterministic_function_handling = 'save'` or `= 'ignore'` to cache the query result regardless or to omit caching. (QUERY_CACHE_USED_WITH_NONDETERMINISTIC_FUNCTIONS), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f4eb7 6. /build/src/Interpreters/executeQuery.cpp:1205: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb2845 7. /build/src/Interpreters/executeQuery.cpp:1496: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb4e89 8. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 9. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 10. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 11. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 12. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 13. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 14. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 15. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 16. ? @ 0x00007f713a222ac3 17. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 10:52:04.974623 [ 3740 ] {d72e6de2-fb82-4c62-b1ee-d3ff55958477} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=1, jobs=1). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:45416) (in query: SELECT version(), arrayStringConcat(groupArray(value), ' ') FROM system.build_options WHERE name IN ('GIT_HASH', 'GIT_BRANCH') ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 13. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 14. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 15. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 16. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 17. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 18. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 19. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 20. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 21. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 22. ? @ 0x00007f713a222ac3 23. ? @ 0x00007f713a2b4850 2024.12.16 10:52:04.986069 [ 3740 ] {d72e6de2-fb82-4c62-b1ee-d3ff55958477} DynamicQueryHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=1, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 13. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 14. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 15. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 16. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 17. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 18. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 19. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 20. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 21. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 22. ? @ 0x00007f713a222ac3 23. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 10:52:05.579827 [ 3568 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::TraceLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=5). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:147: DB::IMergeTreeDataPart::MinMaxIndex::store(std::vector> const&, std::vector, std::allocator>> const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caad019 21. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:118: DB::IMergeTreeDataPart::MinMaxIndex::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caab9fb 22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:244: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39ccf 23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 26. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 (version 24.3.12.76.altinitystable) 2024.12.16 10:52:05.885563 [ 3751 ] {4b5e9d5b-0413-4ed2-bb75-efd39a862f47} executeQuery: Code: 704. DB::Exception: The query result was not cached because the query contains a non-deterministic function. Use setting `query_cache_nondeterministic_function_handling = 'save'` or `= 'ignore'` to cache the query result regardless or to omit caching. (QUERY_CACHE_USED_WITH_NONDETERMINISTIC_FUNCTIONS) (version 24.3.12.76.altinitystable) (from [::1]:45492) (in query: SELECT version(), arrayStringConcat(groupArray(value), ' ') FROM system.build_options WHERE name IN ('GIT_HASH', 'GIT_BRANCH') ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f4eb7 6. /build/src/Interpreters/executeQuery.cpp:1205: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb2845 7. /build/src/Interpreters/executeQuery.cpp:1496: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb4e89 8. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 9. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 10. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 11. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 12. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 13. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 14. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 15. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 16. ? @ 0x00007f713a222ac3 17. ? @ 0x00007f713a2b4850 2024.12.16 10:52:05.940746 [ 3751 ] {4b5e9d5b-0413-4ed2-bb75-efd39a862f47} DynamicQueryHandler: Code: 704. DB::Exception: The query result was not cached because the query contains a non-deterministic function. Use setting `query_cache_nondeterministic_function_handling = 'save'` or `= 'ignore'` to cache the query result regardless or to omit caching. (QUERY_CACHE_USED_WITH_NONDETERMINISTIC_FUNCTIONS), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f4eb7 6. /build/src/Interpreters/executeQuery.cpp:1205: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb2845 7. /build/src/Interpreters/executeQuery.cpp:1496: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb4e89 8. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 9. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 10. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 11. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 12. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 13. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 14. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 15. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 16. ? @ 0x00007f713a222ac3 17. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 10:52:07.954700 [ 3549 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::TextLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:147: DB::IMergeTreeDataPart::MinMaxIndex::store(std::vector> const&, std::vector, std::allocator>> const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caad019 21. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:118: DB::IMergeTreeDataPart::MinMaxIndex::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caab9fb 22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:244: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39ccf 23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 26. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 (version 24.3.12.76.altinitystable) 2024.12.16 10:52:09.455538 [ 2756 ] {d989068b-b9db-494b-a444-3a6b1dd301d0} executeQuery: Code: 475. DB::Exception: Sort FILL TO expression must be constant with numeric type. Actual '2024-02-17'. In scope SELECT * FROM users ORDER BY date ASC WITH FILL TO '2024-02-17' STEP toIntervalHour(1). (INVALID_WITH_FILL_EXPRESSION) (version 24.3.12.76.altinitystable) (from [::1]:36216) (comment: 03248_with_fill_string_crash.sql) (in query: SELECT * FROM users ORDER BY date WITH FILL TO '2024-02-17' STEP toIntervalHour(1);), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000a8f27cc 6. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6729: DB::(anonymous namespace)::QueryAnalyzer::resolveSortNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0ad2fd 7. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8228: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09d443 8. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001b09af74 9. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr&, std::shared_ptr) @ 0x000000001b09ac33 10. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr) @ 0x000000001b08c3a6 11. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr const&, DB::SelectQueryOptions const&, std::shared_ptr const&, std::shared_ptr const&) @ 0x000000001b507dac 12. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x000000001b5069e6 13. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr const&, DB::SelectQueryOptions const&) @ 0x000000001b509db7 14. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50924c 15. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b5091fd 16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b50919d 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b50915d 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b509125 19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b428b1e 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b42409d 21. /build/src/Interpreters/InterpreterFactory.cpp:355: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000001b42372d 22. /build/src/Interpreters/executeQuery.cpp:1133: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb1cb0 23. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 24. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 25. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 26. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 27. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 28. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 29. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 30. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 31. ? @ 0x00007f713a222ac3 2024.12.16 10:52:09.470895 [ 2756 ] {d989068b-b9db-494b-a444-3a6b1dd301d0} TCPHandler: Code: 475. DB::Exception: Sort FILL TO expression must be constant with numeric type. Actual '2024-02-17'. In scope SELECT * FROM users ORDER BY date ASC WITH FILL TO '2024-02-17' STEP toIntervalHour(1). (INVALID_WITH_FILL_EXPRESSION), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000a8f27cc 6. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6729: DB::(anonymous namespace)::QueryAnalyzer::resolveSortNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0ad2fd 7. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8228: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09d443 8. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001b09af74 9. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr&, std::shared_ptr) @ 0x000000001b09ac33 10. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr) @ 0x000000001b08c3a6 11. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr const&, DB::SelectQueryOptions const&, std::shared_ptr const&, std::shared_ptr const&) @ 0x000000001b507dac 12. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x000000001b5069e6 13. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr const&, DB::SelectQueryOptions const&) @ 0x000000001b509db7 14. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50924c 15. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b5091fd 16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b50919d 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b50915d 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b509125 19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b428b1e 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b42409d 21. /build/src/Interpreters/InterpreterFactory.cpp:355: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000001b42372d 22. /build/src/Interpreters/executeQuery.cpp:1133: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb1cb0 23. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 24. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 25. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 26. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 27. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 28. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 29. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 30. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 31. ? @ 0x00007f713a222ac3 2024.12.16 10:52:15.227684 [ 2758 ] {866dd3aa-e6e6-47ff-900d-5266bde8fcb9} executeQuery: Code: 72. DB::Exception: Cannot parse exponent while reading decimal: Cannot parse Decimal(9, 1) from String: In scope SELECT toDecimal32('e', 1). (CANNOT_PARSE_NUMBER) (version 24.3.12.76.altinitystable) (from [::1]:39210) (comment: 01070_to_decimal_or_null_exception.sql) (in query: SELECT toDecimal32('e', 1);), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f4eb7 6. /build/src/IO/readDecimalText.h:124: bool DB::readDigits>(DB::ReadBuffer&, DB::Decimal&, unsigned int&, int&, bool) @ 0x0000000019962886 7. /build/src/IO/readDecimalText.h:157: void DB::readDecimalText, void>(DB::ReadBuffer&, DB::Decimal&, unsigned int, unsigned int&, bool) @ 0x0000000019f57de6 8. /build/src/DataTypes/Serializations/SerializationDecimal.cpp:48: DB::SerializationDecimal>::readText(DB::Decimal&, DB::ReadBuffer&, unsigned int, unsigned int, bool) @ 0x0000000019ff29c1 9. /build/src/Functions/FunctionsConversion.cpp:1005: COW::immutable_ptr DB::(anonymous namespace)::ConvertThroughParsing>, DB::(anonymous namespace)::NameToDecimal32, (DB::(anonymous namespace)::ConvertFromStringExceptionMode)0, (DB::(anonymous namespace)::ConvertFromStringParsingMode)0>::execute(std::vector> const&, std::shared_ptr const&, unsigned long, unsigned int) @ 0x000000000ade0b77 10. /build/src/Functions/FunctionsConversion.cpp:1545: COW::immutable_ptr DB::(anonymous namespace)::ConvertImpl>, DB::(anonymous namespace)::NameToDecimal32, (DB::FormatSettings::DateTimeOverflowBehavior)0>::execute(std::vector> const&, std::shared_ptr const&, unsigned long, DB::(anonymous namespace)::BehaviourOnErrorFromString, unsigned int) @ 0x000000000ade052f 11. /build/src/Functions/FunctionsConversion.cpp:2201: bool DB::(anonymous namespace)::FunctionConvert>, DB::(anonymous namespace)::NameToDecimal32, DB::(anonymous namespace)::UnknownMonotonicity>::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const::'lambda'(auto const&, DB::(anonymous namespace)::BehaviourOnErrorFromString)::operator()>>>(auto const&, DB::(anonymous namespace)::BehaviourOnErrorFromString) const @ 0x000000000add0b53 12. /build/src/Core/callOnTypeIndex.h:205: bool DB::callOnIndexAndDataType>, DB::(anonymous namespace)::FunctionConvert>, DB::(anonymous namespace)::NameToDecimal32, DB::(anonymous namespace)::UnknownMonotonicity>::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const::'lambda'(auto const&, DB::(anonymous namespace)::BehaviourOnErrorFromString)&, DB::(anonymous namespace)::BehaviourOnErrorFromString>(DB::TypeIndex, DB::(anonymous namespace)::FunctionConvert>, DB::(anonymous namespace)::NameToDecimal32, DB::(anonymous namespace)::UnknownMonotonicity>::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const::'lambda'(auto const&, DB::(anonymous namespace)::BehaviourOnErrorFromString)&, DB::(anonymous namespace)::BehaviourOnErrorFromString&&) @ 0x000000000adcce98 13. /build/src/Functions/FunctionsConversion.cpp:2319: DB::(anonymous namespace)::FunctionConvert>, DB::(anonymous namespace)::NameToDecimal32, DB::(anonymous namespace)::UnknownMonotonicity>::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000adcc9ad 14. /build/src/Functions/FunctionsConversion.cpp:2110: DB::(anonymous namespace)::FunctionConvert>, DB::(anonymous namespace)::NameToDecimal32, DB::(anonymous namespace)::UnknownMonotonicity>::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000adcbdbe 15. /build/src/Functions/IFunction.h:443: DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000a8ef299 16. /build/src/Functions/IFunctionAdaptors.h:26: DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000af6a9ad 17. /build/src/Functions/IFunction.cpp:277: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019062706 18. /build/src/Functions/IFunction.cpp:191: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019062283 19. /build/src/Functions/IFunction.cpp:269: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x00000000190625e3 20. /build/src/Functions/IFunction.cpp:336: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019063826 21. /build/src/Functions/IFunction.cpp:411: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x00000000190648b5 22. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6185: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bdb89 23. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a24ea 24. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a0a21 25. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0ab1c7 26. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09cd43 27. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001b09af74 28. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr&, std::shared_ptr) @ 0x000000001b09ac33 29. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr) @ 0x000000001b08c3a6 30. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr const&, DB::SelectQueryOptions const&, std::shared_ptr const&, std::shared_ptr const&) @ 0x000000001b507dac 31. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x000000001b5069e6 2024.12.16 10:52:15.236311 [ 2758 ] {866dd3aa-e6e6-47ff-900d-5266bde8fcb9} TCPHandler: Code: 72. DB::Exception: Cannot parse exponent while reading decimal: Cannot parse Decimal(9, 1) from String: In scope SELECT toDecimal32('e', 1). (CANNOT_PARSE_NUMBER), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f4eb7 6. /build/src/IO/readDecimalText.h:124: bool DB::readDigits>(DB::ReadBuffer&, DB::Decimal&, unsigned int&, int&, bool) @ 0x0000000019962886 7. /build/src/IO/readDecimalText.h:157: void DB::readDecimalText, void>(DB::ReadBuffer&, DB::Decimal&, unsigned int, unsigned int&, bool) @ 0x0000000019f57de6 8. /build/src/DataTypes/Serializations/SerializationDecimal.cpp:48: DB::SerializationDecimal>::readText(DB::Decimal&, DB::ReadBuffer&, unsigned int, unsigned int, bool) @ 0x0000000019ff29c1 9. /build/src/Functions/FunctionsConversion.cpp:1005: COW::immutable_ptr DB::(anonymous namespace)::ConvertThroughParsing>, DB::(anonymous namespace)::NameToDecimal32, (DB::(anonymous namespace)::ConvertFromStringExceptionMode)0, (DB::(anonymous namespace)::ConvertFromStringParsingMode)0>::execute(std::vector> const&, std::shared_ptr const&, unsigned long, unsigned int) @ 0x000000000ade0b77 10. /build/src/Functions/FunctionsConversion.cpp:1545: COW::immutable_ptr DB::(anonymous namespace)::ConvertImpl>, DB::(anonymous namespace)::NameToDecimal32, (DB::FormatSettings::DateTimeOverflowBehavior)0>::execute(std::vector> const&, std::shared_ptr const&, unsigned long, DB::(anonymous namespace)::BehaviourOnErrorFromString, unsigned int) @ 0x000000000ade052f 11. /build/src/Functions/FunctionsConversion.cpp:2201: bool DB::(anonymous namespace)::FunctionConvert>, DB::(anonymous namespace)::NameToDecimal32, DB::(anonymous namespace)::UnknownMonotonicity>::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const::'lambda'(auto const&, DB::(anonymous namespace)::BehaviourOnErrorFromString)::operator()>>>(auto const&, DB::(anonymous namespace)::BehaviourOnErrorFromString) const @ 0x000000000add0b53 12. /build/src/Core/callOnTypeIndex.h:205: bool DB::callOnIndexAndDataType>, DB::(anonymous namespace)::FunctionConvert>, DB::(anonymous namespace)::NameToDecimal32, DB::(anonymous namespace)::UnknownMonotonicity>::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const::'lambda'(auto const&, DB::(anonymous namespace)::BehaviourOnErrorFromString)&, DB::(anonymous namespace)::BehaviourOnErrorFromString>(DB::TypeIndex, DB::(anonymous namespace)::FunctionConvert>, DB::(anonymous namespace)::NameToDecimal32, DB::(anonymous namespace)::UnknownMonotonicity>::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const::'lambda'(auto const&, DB::(anonymous namespace)::BehaviourOnErrorFromString)&, DB::(anonymous namespace)::BehaviourOnErrorFromString&&) @ 0x000000000adcce98 13. /build/src/Functions/FunctionsConversion.cpp:2319: DB::(anonymous namespace)::FunctionConvert>, DB::(anonymous namespace)::NameToDecimal32, DB::(anonymous namespace)::UnknownMonotonicity>::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000adcc9ad 14. /build/src/Functions/FunctionsConversion.cpp:2110: DB::(anonymous namespace)::FunctionConvert>, DB::(anonymous namespace)::NameToDecimal32, DB::(anonymous namespace)::UnknownMonotonicity>::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000adcbdbe 15. /build/src/Functions/IFunction.h:443: DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000a8ef299 16. /build/src/Functions/IFunctionAdaptors.h:26: DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000af6a9ad 17. /build/src/Functions/IFunction.cpp:277: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019062706 18. /build/src/Functions/IFunction.cpp:191: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019062283 19. /build/src/Functions/IFunction.cpp:269: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x00000000190625e3 20. /build/src/Functions/IFunction.cpp:336: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019063826 21. /build/src/Functions/IFunction.cpp:411: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x00000000190648b5 22. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6185: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bdb89 23. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a24ea 24. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a0a21 25. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0ab1c7 26. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09cd43 27. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001b09af74 28. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr&, std::shared_ptr) @ 0x000000001b09ac33 29. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr) @ 0x000000001b08c3a6 30. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr const&, DB::SelectQueryOptions const&, std::shared_ptr const&, std::shared_ptr const&) @ 0x000000001b507dac 31. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x000000001b5069e6 2024.12.16 10:52:15.563946 [ 2758 ] {5185c4dd-8819-4e84-989e-eb9d9deab2ef} executeQuery: Code: 72. DB::Exception: Cannot parse exponent while reading decimal: Cannot parse Decimal(18, 2) from String: In scope SELECT toDecimal64('e', 2). (CANNOT_PARSE_NUMBER) (version 24.3.12.76.altinitystable) (from [::1]:39210) (comment: 01070_to_decimal_or_null_exception.sql) (in query: SELECT toDecimal64('e', 2);), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f4eb7 6. /build/src/IO/readDecimalText.h:124: bool DB::readDigits>(DB::ReadBuffer&, DB::Decimal&, unsigned int&, int&, bool) @ 0x000000001996309f 7. /build/src/IO/readDecimalText.h:157: void DB::readDecimalText, void>(DB::ReadBuffer&, DB::Decimal&, unsigned int, unsigned int&, bool) @ 0x0000000019f584e6 8. /build/src/DataTypes/Serializations/SerializationDecimal.cpp:48: DB::SerializationDecimal>::readText(DB::Decimal&, DB::ReadBuffer&, unsigned int, unsigned int, bool) @ 0x0000000019ff34a1 9. /build/src/Functions/FunctionsConversion.cpp:1005: COW::immutable_ptr DB::(anonymous namespace)::ConvertThroughParsing>, DB::(anonymous namespace)::NameToDecimal64, (DB::(anonymous namespace)::ConvertFromStringExceptionMode)0, (DB::(anonymous namespace)::ConvertFromStringParsingMode)0>::execute(std::vector> const&, std::shared_ptr const&, unsigned long, unsigned int) @ 0x000000000adfab57 10. /build/src/Functions/FunctionsConversion.cpp:1545: COW::immutable_ptr DB::(anonymous namespace)::ConvertImpl>, DB::(anonymous namespace)::NameToDecimal64, (DB::FormatSettings::DateTimeOverflowBehavior)0>::execute(std::vector> const&, std::shared_ptr const&, unsigned long, DB::(anonymous namespace)::BehaviourOnErrorFromString, unsigned int) @ 0x000000000adfa50f 11. /build/src/Functions/FunctionsConversion.cpp:2201: bool DB::(anonymous namespace)::FunctionConvert>, DB::(anonymous namespace)::NameToDecimal64, DB::(anonymous namespace)::UnknownMonotonicity>::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const::'lambda'(auto const&, DB::(anonymous namespace)::BehaviourOnErrorFromString)::operator()>>>(auto const&, DB::(anonymous namespace)::BehaviourOnErrorFromString) const @ 0x000000000adea953 12. /build/src/Core/callOnTypeIndex.h:205: bool DB::callOnIndexAndDataType>, DB::(anonymous namespace)::FunctionConvert>, DB::(anonymous namespace)::NameToDecimal64, DB::(anonymous namespace)::UnknownMonotonicity>::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const::'lambda'(auto const&, DB::(anonymous namespace)::BehaviourOnErrorFromString)&, DB::(anonymous namespace)::BehaviourOnErrorFromString>(DB::TypeIndex, DB::(anonymous namespace)::FunctionConvert>, DB::(anonymous namespace)::NameToDecimal64, DB::(anonymous namespace)::UnknownMonotonicity>::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const::'lambda'(auto const&, DB::(anonymous namespace)::BehaviourOnErrorFromString)&, DB::(anonymous namespace)::BehaviourOnErrorFromString&&) @ 0x000000000ade6c98 13. /build/src/Functions/FunctionsConversion.cpp:2319: DB::(anonymous namespace)::FunctionConvert>, DB::(anonymous namespace)::NameToDecimal64, DB::(anonymous namespace)::UnknownMonotonicity>::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000ade67ad 14. /build/src/Functions/FunctionsConversion.cpp:2110: DB::(anonymous namespace)::FunctionConvert>, DB::(anonymous namespace)::NameToDecimal64, DB::(anonymous namespace)::UnknownMonotonicity>::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000ade5bbe 15. /build/src/Functions/IFunction.h:443: DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000a8ef299 16. /build/src/Functions/IFunctionAdaptors.h:26: DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000af6a9ad 17. /build/src/Functions/IFunction.cpp:277: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019062706 18. /build/src/Functions/IFunction.cpp:191: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019062283 19. /build/src/Functions/IFunction.cpp:269: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x00000000190625e3 20. /build/src/Functions/IFunction.cpp:336: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019063826 21. /build/src/Functions/IFunction.cpp:411: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x00000000190648b5 22. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6185: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bdb89 23. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a24ea 24. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a0a21 25. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0ab1c7 26. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09cd43 27. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001b09af74 28. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr&, std::shared_ptr) @ 0x000000001b09ac33 29. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr) @ 0x000000001b08c3a6 30. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr const&, DB::SelectQueryOptions const&, std::shared_ptr const&, std::shared_ptr const&) @ 0x000000001b507dac 31. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x000000001b5069e6 2024.12.16 10:52:15.578877 [ 2758 ] {5185c4dd-8819-4e84-989e-eb9d9deab2ef} TCPHandler: Code: 72. DB::Exception: Cannot parse exponent while reading decimal: Cannot parse Decimal(18, 2) from String: In scope SELECT toDecimal64('e', 2). (CANNOT_PARSE_NUMBER), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f4eb7 6. /build/src/IO/readDecimalText.h:124: bool DB::readDigits>(DB::ReadBuffer&, DB::Decimal&, unsigned int&, int&, bool) @ 0x000000001996309f 7. /build/src/IO/readDecimalText.h:157: void DB::readDecimalText, void>(DB::ReadBuffer&, DB::Decimal&, unsigned int, unsigned int&, bool) @ 0x0000000019f584e6 8. /build/src/DataTypes/Serializations/SerializationDecimal.cpp:48: DB::SerializationDecimal>::readText(DB::Decimal&, DB::ReadBuffer&, unsigned int, unsigned int, bool) @ 0x0000000019ff34a1 9. /build/src/Functions/FunctionsConversion.cpp:1005: COW::immutable_ptr DB::(anonymous namespace)::ConvertThroughParsing>, DB::(anonymous namespace)::NameToDecimal64, (DB::(anonymous namespace)::ConvertFromStringExceptionMode)0, (DB::(anonymous namespace)::ConvertFromStringParsingMode)0>::execute(std::vector> const&, std::shared_ptr const&, unsigned long, unsigned int) @ 0x000000000adfab57 10. /build/src/Functions/FunctionsConversion.cpp:1545: COW::immutable_ptr DB::(anonymous namespace)::ConvertImpl>, DB::(anonymous namespace)::NameToDecimal64, (DB::FormatSettings::DateTimeOverflowBehavior)0>::execute(std::vector> const&, std::shared_ptr const&, unsigned long, DB::(anonymous namespace)::BehaviourOnErrorFromString, unsigned int) @ 0x000000000adfa50f 11. /build/src/Functions/FunctionsConversion.cpp:2201: bool DB::(anonymous namespace)::FunctionConvert>, DB::(anonymous namespace)::NameToDecimal64, DB::(anonymous namespace)::UnknownMonotonicity>::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const::'lambda'(auto const&, DB::(anonymous namespace)::BehaviourOnErrorFromString)::operator()>>>(auto const&, DB::(anonymous namespace)::BehaviourOnErrorFromString) const @ 0x000000000adea953 12. /build/src/Core/callOnTypeIndex.h:205: bool DB::callOnIndexAndDataType>, DB::(anonymous namespace)::FunctionConvert>, DB::(anonymous namespace)::NameToDecimal64, DB::(anonymous namespace)::UnknownMonotonicity>::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const::'lambda'(auto const&, DB::(anonymous namespace)::BehaviourOnErrorFromString)&, DB::(anonymous namespace)::BehaviourOnErrorFromString>(DB::TypeIndex, DB::(anonymous namespace)::FunctionConvert>, DB::(anonymous namespace)::NameToDecimal64, DB::(anonymous namespace)::UnknownMonotonicity>::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const::'lambda'(auto const&, DB::(anonymous namespace)::BehaviourOnErrorFromString)&, DB::(anonymous namespace)::BehaviourOnErrorFromString&&) @ 0x000000000ade6c98 13. /build/src/Functions/FunctionsConversion.cpp:2319: DB::(anonymous namespace)::FunctionConvert>, DB::(anonymous namespace)::NameToDecimal64, DB::(anonymous namespace)::UnknownMonotonicity>::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000ade67ad 14. /build/src/Functions/FunctionsConversion.cpp:2110: DB::(anonymous namespace)::FunctionConvert>, DB::(anonymous namespace)::NameToDecimal64, DB::(anonymous namespace)::UnknownMonotonicity>::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000ade5bbe 15. /build/src/Functions/IFunction.h:443: DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000a8ef299 16. /build/src/Functions/IFunctionAdaptors.h:26: DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000af6a9ad 17. /build/src/Functions/IFunction.cpp:277: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019062706 18. /build/src/Functions/IFunction.cpp:191: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019062283 19. /build/src/Functions/IFunction.cpp:269: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x00000000190625e3 20. /build/src/Functions/IFunction.cpp:336: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019063826 21. /build/src/Functions/IFunction.cpp:411: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x00000000190648b5 22. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6185: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bdb89 23. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a24ea 24. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a0a21 25. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0ab1c7 26. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09cd43 27. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001b09af74 28. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr&, std::shared_ptr) @ 0x000000001b09ac33 29. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr) @ 0x000000001b08c3a6 30. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr const&, DB::SelectQueryOptions const&, std::shared_ptr const&, std::shared_ptr const&) @ 0x000000001b507dac 31. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x000000001b5069e6 2024.12.16 10:52:16.075489 [ 2758 ] {5c030f95-315f-42f3-8a7c-94fe0faeab65} executeQuery: Code: 72. DB::Exception: Cannot parse exponent while reading decimal: Cannot parse Decimal(38, 3) from String: In scope SELECT toDecimal128('e', 3). (CANNOT_PARSE_NUMBER) (version 24.3.12.76.altinitystable) (from [::1]:39210) (comment: 01070_to_decimal_or_null_exception.sql) (in query: SELECT toDecimal128('e', 3);), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f4eb7 6. /build/src/IO/readDecimalText.h:124: bool DB::readDigits>>(DB::ReadBuffer&, DB::Decimal>&, unsigned int&, int&, bool) @ 0x0000000019963934 7. /build/src/IO/readDecimalText.h:157: void DB::readDecimalText>, void>(DB::ReadBuffer&, DB::Decimal>&, unsigned int, unsigned int&, bool) @ 0x0000000019f58c26 8. /build/src/DataTypes/Serializations/SerializationDecimal.cpp:48: DB::SerializationDecimal>>::readText(DB::Decimal>&, DB::ReadBuffer&, unsigned int, unsigned int, bool) @ 0x0000000019ff3fc1 9. /build/src/Functions/FunctionsConversion.cpp:1005: COW::immutable_ptr DB::(anonymous namespace)::ConvertThroughParsing>>, DB::(anonymous namespace)::NameToDecimal128, (DB::(anonymous namespace)::ConvertFromStringExceptionMode)0, (DB::(anonymous namespace)::ConvertFromStringParsingMode)0>::execute(std::vector> const&, std::shared_ptr const&, unsigned long, unsigned int) @ 0x000000000ae15217 10. /build/src/Functions/FunctionsConversion.cpp:1545: COW::immutable_ptr DB::(anonymous namespace)::ConvertImpl>>, DB::(anonymous namespace)::NameToDecimal128, (DB::FormatSettings::DateTimeOverflowBehavior)0>::execute(std::vector> const&, std::shared_ptr const&, unsigned long, DB::(anonymous namespace)::BehaviourOnErrorFromString, unsigned int) @ 0x000000000ae14bcf 11. /build/src/Functions/FunctionsConversion.cpp:2201: bool DB::(anonymous namespace)::FunctionConvert>>, DB::(anonymous namespace)::NameToDecimal128, DB::(anonymous namespace)::UnknownMonotonicity>::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const::'lambda'(auto const&, DB::(anonymous namespace)::BehaviourOnErrorFromString)::operator()>>>>(auto const&, DB::(anonymous namespace)::BehaviourOnErrorFromString) const @ 0x000000000ae048f3 12. /build/src/Core/callOnTypeIndex.h:205: bool DB::callOnIndexAndDataType>>, DB::(anonymous namespace)::FunctionConvert>>, DB::(anonymous namespace)::NameToDecimal128, DB::(anonymous namespace)::UnknownMonotonicity>::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const::'lambda'(auto const&, DB::(anonymous namespace)::BehaviourOnErrorFromString)&, DB::(anonymous namespace)::BehaviourOnErrorFromString>(DB::TypeIndex, DB::(anonymous namespace)::FunctionConvert>>, DB::(anonymous namespace)::NameToDecimal128, DB::(anonymous namespace)::UnknownMonotonicity>::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const::'lambda'(auto const&, DB::(anonymous namespace)::BehaviourOnErrorFromString)&, DB::(anonymous namespace)::BehaviourOnErrorFromString&&) @ 0x000000000ae00c38 13. /build/src/Functions/FunctionsConversion.cpp:2319: DB::(anonymous namespace)::FunctionConvert>>, DB::(anonymous namespace)::NameToDecimal128, DB::(anonymous namespace)::UnknownMonotonicity>::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000ae0074d 14. /build/src/Functions/FunctionsConversion.cpp:2110: DB::(anonymous namespace)::FunctionConvert>>, DB::(anonymous namespace)::NameToDecimal128, DB::(anonymous namespace)::UnknownMonotonicity>::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000adffb5e 15. /build/src/Functions/IFunction.h:443: DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000a8ef299 16. /build/src/Functions/IFunctionAdaptors.h:26: DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000af6a9ad 17. /build/src/Functions/IFunction.cpp:277: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019062706 18. /build/src/Functions/IFunction.cpp:191: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019062283 19. /build/src/Functions/IFunction.cpp:269: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x00000000190625e3 20. /build/src/Functions/IFunction.cpp:336: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019063826 21. /build/src/Functions/IFunction.cpp:411: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x00000000190648b5 22. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6185: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bdb89 23. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a24ea 24. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a0a21 25. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0ab1c7 26. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09cd43 27. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001b09af74 28. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr&, std::shared_ptr) @ 0x000000001b09ac33 29. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr) @ 0x000000001b08c3a6 30. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr const&, DB::SelectQueryOptions const&, std::shared_ptr const&, std::shared_ptr const&) @ 0x000000001b507dac 31. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x000000001b5069e6 2024.12.16 10:52:16.096545 [ 2758 ] {5c030f95-315f-42f3-8a7c-94fe0faeab65} TCPHandler: Code: 72. DB::Exception: Cannot parse exponent while reading decimal: Cannot parse Decimal(38, 3) from String: In scope SELECT toDecimal128('e', 3). (CANNOT_PARSE_NUMBER), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f4eb7 6. /build/src/IO/readDecimalText.h:124: bool DB::readDigits>>(DB::ReadBuffer&, DB::Decimal>&, unsigned int&, int&, bool) @ 0x0000000019963934 7. /build/src/IO/readDecimalText.h:157: void DB::readDecimalText>, void>(DB::ReadBuffer&, DB::Decimal>&, unsigned int, unsigned int&, bool) @ 0x0000000019f58c26 8. /build/src/DataTypes/Serializations/SerializationDecimal.cpp:48: DB::SerializationDecimal>>::readText(DB::Decimal>&, DB::ReadBuffer&, unsigned int, unsigned int, bool) @ 0x0000000019ff3fc1 9. /build/src/Functions/FunctionsConversion.cpp:1005: COW::immutable_ptr DB::(anonymous namespace)::ConvertThroughParsing>>, DB::(anonymous namespace)::NameToDecimal128, (DB::(anonymous namespace)::ConvertFromStringExceptionMode)0, (DB::(anonymous namespace)::ConvertFromStringParsingMode)0>::execute(std::vector> const&, std::shared_ptr const&, unsigned long, unsigned int) @ 0x000000000ae15217 10. /build/src/Functions/FunctionsConversion.cpp:1545: COW::immutable_ptr DB::(anonymous namespace)::ConvertImpl>>, DB::(anonymous namespace)::NameToDecimal128, (DB::FormatSettings::DateTimeOverflowBehavior)0>::execute(std::vector> const&, std::shared_ptr const&, unsigned long, DB::(anonymous namespace)::BehaviourOnErrorFromString, unsigned int) @ 0x000000000ae14bcf 11. /build/src/Functions/FunctionsConversion.cpp:2201: bool DB::(anonymous namespace)::FunctionConvert>>, DB::(anonymous namespace)::NameToDecimal128, DB::(anonymous namespace)::UnknownMonotonicity>::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const::'lambda'(auto const&, DB::(anonymous namespace)::BehaviourOnErrorFromString)::operator()>>>>(auto const&, DB::(anonymous namespace)::BehaviourOnErrorFromString) const @ 0x000000000ae048f3 12. /build/src/Core/callOnTypeIndex.h:205: bool DB::callOnIndexAndDataType>>, DB::(anonymous namespace)::FunctionConvert>>, DB::(anonymous namespace)::NameToDecimal128, DB::(anonymous namespace)::UnknownMonotonicity>::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const::'lambda'(auto const&, DB::(anonymous namespace)::BehaviourOnErrorFromString)&, DB::(anonymous namespace)::BehaviourOnErrorFromString>(DB::TypeIndex, DB::(anonymous namespace)::FunctionConvert>>, DB::(anonymous namespace)::NameToDecimal128, DB::(anonymous namespace)::UnknownMonotonicity>::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const::'lambda'(auto const&, DB::(anonymous namespace)::BehaviourOnErrorFromString)&, DB::(anonymous namespace)::BehaviourOnErrorFromString&&) @ 0x000000000ae00c38 13. /build/src/Functions/FunctionsConversion.cpp:2319: DB::(anonymous namespace)::FunctionConvert>>, DB::(anonymous namespace)::NameToDecimal128, DB::(anonymous namespace)::UnknownMonotonicity>::executeInternal(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000ae0074d 14. /build/src/Functions/FunctionsConversion.cpp:2110: DB::(anonymous namespace)::FunctionConvert>>, DB::(anonymous namespace)::NameToDecimal128, DB::(anonymous namespace)::UnknownMonotonicity>::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000adffb5e 15. /build/src/Functions/IFunction.h:443: DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000a8ef299 16. /build/src/Functions/IFunctionAdaptors.h:26: DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000af6a9ad 17. /build/src/Functions/IFunction.cpp:277: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019062706 18. /build/src/Functions/IFunction.cpp:191: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019062283 19. /build/src/Functions/IFunction.cpp:269: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x00000000190625e3 20. /build/src/Functions/IFunction.cpp:336: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019063826 21. /build/src/Functions/IFunction.cpp:411: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x00000000190648b5 22. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6185: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bdb89 23. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a24ea 24. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a0a21 25. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0ab1c7 26. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09cd43 27. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001b09af74 28. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr&, std::shared_ptr) @ 0x000000001b09ac33 29. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr) @ 0x000000001b08c3a6 30. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr const&, DB::SelectQueryOptions const&, std::shared_ptr const&, std::shared_ptr const&) @ 0x000000001b507dac 31. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x000000001b5069e6 2024.12.16 10:52:17.823321 [ 3855 ] {cd733b01-fdba-4599-95e2-3086e37cba83} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=22, jobs=22). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:39178) (comment: 00145_aggregate_functions_statistics.sql) (in query: SELECT round(varSamp(ResolutionWidth), 6) FROM test.hits;), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:52:18.361512 [ 3855 ] {cd733b01-fdba-4599-95e2-3086e37cba83} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=22, jobs=22). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:52:19.971082 [ 3740 ] {25176f16-98f1-4c4f-9214-c210a6870413} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=13, jobs=13). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::ffff:127.0.0.1]:50306) (in query: SELECT COUNT() FROM tmp_table), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:52:19.998954 [ 3740 ] {25176f16-98f1-4c4f-9214-c210a6870413} DynamicQueryHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=13, jobs=13). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 (version 24.3.12.76.altinitystable) 2024.12.16 10:52:20.365224 [ 3868 ] {700d3ab3-2619-447e-b548-b57a32dbd2c5} executeQuery: Code: 291. DB::Exception: Direct access to `_temporary_and_external_tables` database is not allowed. (DATABASE_ACCESS_DENIED) (version 24.3.12.76.altinitystable) (from [::ffff:127.0.0.1]:50318) (in query: SELECT COUNT() FROM _temporary_and_external_tables.`_tmp_16b8564d-11f1-444e-8db9-ec4153d1994d`), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, char const* const&) @ 0x000000000aa1bdf3 6. /build/src/Interpreters/DatabaseCatalog.cpp:385: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000001a66f828 7. /build/src/Interpreters/DatabaseCatalog.cpp:952: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000001a6752e3 8. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:2653: DB::(anonymous namespace)::QueryAnalyzer::tryResolveTableIdentifierFromDatabaseCatalog(DB::Identifier const&, std::shared_ptr) @ 0x000000001b0b2896 9. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:4213: DB::(anonymous namespace)::QueryAnalyzer::tryResolveIdentifier(DB::(anonymous namespace)::IdentifierLookup const&, DB::(anonymous namespace)::IdentifierResolveScope&, DB::(anonymous namespace)::IdentifierResolveSettings) @ 0x000000001b0b0486 10. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6960: DB::(anonymous namespace)::QueryAnalyzer::initializeQueryJoinTreeNode(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a9bbf 11. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8159: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09cca3 12. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001b09af74 13. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr&, std::shared_ptr) @ 0x000000001b09ac33 14. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr) @ 0x000000001b08c3a6 15. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr const&, DB::SelectQueryOptions const&, std::shared_ptr const&, std::shared_ptr const&) @ 0x000000001b507dac 16. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x000000001b5069e6 17. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr const&, DB::SelectQueryOptions const&) @ 0x000000001b509db7 18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50924c 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b5091fd 20. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b50919d 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b50915d 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b509125 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b428b1e 24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b42409d 25. /build/src/Interpreters/InterpreterFactory.cpp:355: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000001b42372d 26. /build/src/Interpreters/executeQuery.cpp:1133: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb1cb0 27. /build/src/Interpreters/executeQuery.cpp:1496: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb4e89 28. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 29. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 30. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 31. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 2024.12.16 10:52:20.385252 [ 3868 ] {700d3ab3-2619-447e-b548-b57a32dbd2c5} DynamicQueryHandler: Code: 291. DB::Exception: Direct access to `_temporary_and_external_tables` database is not allowed. (DATABASE_ACCESS_DENIED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, char const* const&) @ 0x000000000aa1bdf3 6. /build/src/Interpreters/DatabaseCatalog.cpp:385: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000001a66f828 7. /build/src/Interpreters/DatabaseCatalog.cpp:952: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000001a6752e3 8. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:2653: DB::(anonymous namespace)::QueryAnalyzer::tryResolveTableIdentifierFromDatabaseCatalog(DB::Identifier const&, std::shared_ptr) @ 0x000000001b0b2896 9. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:4213: DB::(anonymous namespace)::QueryAnalyzer::tryResolveIdentifier(DB::(anonymous namespace)::IdentifierLookup const&, DB::(anonymous namespace)::IdentifierResolveScope&, DB::(anonymous namespace)::IdentifierResolveSettings) @ 0x000000001b0b0486 10. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6960: DB::(anonymous namespace)::QueryAnalyzer::initializeQueryJoinTreeNode(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a9bbf 11. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8159: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09cca3 12. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001b09af74 13. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr&, std::shared_ptr) @ 0x000000001b09ac33 14. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr) @ 0x000000001b08c3a6 15. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr const&, DB::SelectQueryOptions const&, std::shared_ptr const&, std::shared_ptr const&) @ 0x000000001b507dac 16. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x000000001b5069e6 17. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr const&, DB::SelectQueryOptions const&) @ 0x000000001b509db7 18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50924c 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b5091fd 20. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b50919d 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b50915d 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b509125 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b428b1e 24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b42409d 25. /build/src/Interpreters/InterpreterFactory.cpp:355: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000001b42372d 26. /build/src/Interpreters/executeQuery.cpp:1133: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb1cb0 27. /build/src/Interpreters/executeQuery.cpp:1496: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb4e89 28. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 29. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 30. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 31. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 (version 24.3.12.76.altinitystable) 2024.12.16 10:52:20.701485 [ 3740 ] {3133f35d-7bbe-463b-8f11-ab6238c59ab0} executeQuery: Code: 291. DB::Exception: Direct access to `_temporary_and_external_tables` database is not allowed. (DATABASE_ACCESS_DENIED) (version 24.3.12.76.altinitystable) (from [::ffff:127.0.0.1]:50322) (in query: SELECT COUNT() FROM _temporary_and_external_tables.`_tmp_16b8564d-11f1-444e-8db9-ec4153d1994d`), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, char const* const&) @ 0x000000000aa1bdf3 6. /build/src/Interpreters/DatabaseCatalog.cpp:385: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000001a66f828 7. /build/src/Interpreters/DatabaseCatalog.cpp:952: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000001a6752e3 8. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:2653: DB::(anonymous namespace)::QueryAnalyzer::tryResolveTableIdentifierFromDatabaseCatalog(DB::Identifier const&, std::shared_ptr) @ 0x000000001b0b2896 9. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:4213: DB::(anonymous namespace)::QueryAnalyzer::tryResolveIdentifier(DB::(anonymous namespace)::IdentifierLookup const&, DB::(anonymous namespace)::IdentifierResolveScope&, DB::(anonymous namespace)::IdentifierResolveSettings) @ 0x000000001b0b0486 10. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6960: DB::(anonymous namespace)::QueryAnalyzer::initializeQueryJoinTreeNode(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a9bbf 11. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8159: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09cca3 12. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001b09af74 13. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr&, std::shared_ptr) @ 0x000000001b09ac33 14. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr) @ 0x000000001b08c3a6 15. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr const&, DB::SelectQueryOptions const&, std::shared_ptr const&, std::shared_ptr const&) @ 0x000000001b507dac 16. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x000000001b5069e6 17. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr const&, DB::SelectQueryOptions const&) @ 0x000000001b509db7 18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50924c 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b5091fd 20. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b50919d 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b50915d 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b509125 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b428b1e 24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b42409d 25. /build/src/Interpreters/InterpreterFactory.cpp:355: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000001b42372d 26. /build/src/Interpreters/executeQuery.cpp:1133: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb1cb0 27. /build/src/Interpreters/executeQuery.cpp:1496: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb4e89 28. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 29. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 30. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 31. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 2024.12.16 10:52:20.722804 [ 3740 ] {3133f35d-7bbe-463b-8f11-ab6238c59ab0} DynamicQueryHandler: Code: 291. DB::Exception: Direct access to `_temporary_and_external_tables` database is not allowed. (DATABASE_ACCESS_DENIED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, char const* const&) @ 0x000000000aa1bdf3 6. /build/src/Interpreters/DatabaseCatalog.cpp:385: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000001a66f828 7. /build/src/Interpreters/DatabaseCatalog.cpp:952: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000001a6752e3 8. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:2653: DB::(anonymous namespace)::QueryAnalyzer::tryResolveTableIdentifierFromDatabaseCatalog(DB::Identifier const&, std::shared_ptr) @ 0x000000001b0b2896 9. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:4213: DB::(anonymous namespace)::QueryAnalyzer::tryResolveIdentifier(DB::(anonymous namespace)::IdentifierLookup const&, DB::(anonymous namespace)::IdentifierResolveScope&, DB::(anonymous namespace)::IdentifierResolveSettings) @ 0x000000001b0b0486 10. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6960: DB::(anonymous namespace)::QueryAnalyzer::initializeQueryJoinTreeNode(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a9bbf 11. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8159: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09cca3 12. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001b09af74 13. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr&, std::shared_ptr) @ 0x000000001b09ac33 14. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr) @ 0x000000001b08c3a6 15. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr const&, DB::SelectQueryOptions const&, std::shared_ptr const&, std::shared_ptr const&) @ 0x000000001b507dac 16. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x000000001b5069e6 17. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr const&, DB::SelectQueryOptions const&) @ 0x000000001b509db7 18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50924c 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b5091fd 20. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b50919d 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b50915d 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b509125 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b428b1e 24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b42409d 25. /build/src/Interpreters/InterpreterFactory.cpp:355: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000001b42372d 26. /build/src/Interpreters/executeQuery.cpp:1133: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb1cb0 27. /build/src/Interpreters/executeQuery.cpp:1496: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb4e89 28. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 29. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 30. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 31. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 (version 24.3.12.76.altinitystable) 2024.12.16 10:52:21.104039 [ 3731 ] {0c8be02d-50eb-441d-9a7f-d7981b1db809} executeQuery: Code: 370. DB::Exception: Data type Nullable(Nothing) of column 'x' cannot be used in tables. (DATA_TYPE_CANNOT_BE_USED_IN_TABLES) (version 24.3.12.76.altinitystable) (from [::1]:60266) (comment: 03243_check_for_nullable_nothing_in_alter.sql) (in query: alter table src modify column x Nullable(Nothing);), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String const&) @ 0x000000000b49968c 6. /build/src/Storages/StorageFactory.cpp:30: DB::checkAllTypesAreAllowedInTable(DB::NamesAndTypesList const&) @ 0x000000001c36c1ab 7. /build/src/Storages/AlterCommands.cpp:1373: DB::AlterCommands::validate(std::shared_ptr const&, std::shared_ptr) const @ 0x000000001c2513c1 8. /build/src/Interpreters/InterpreterAlterQuery.cpp:198: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001affa152 9. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff7cde 10. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 11. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 12. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 13. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 14. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 15. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 16. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 17. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 18. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 19. ? @ 0x00007f713a222ac3 20. ? @ 0x00007f713a2b4850 2024.12.16 10:52:21.109795 [ 3731 ] {0c8be02d-50eb-441d-9a7f-d7981b1db809} TCPHandler: Code: 370. DB::Exception: Data type Nullable(Nothing) of column 'x' cannot be used in tables. (DATA_TYPE_CANNOT_BE_USED_IN_TABLES), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String const&) @ 0x000000000b49968c 6. /build/src/Storages/StorageFactory.cpp:30: DB::checkAllTypesAreAllowedInTable(DB::NamesAndTypesList const&) @ 0x000000001c36c1ab 7. /build/src/Storages/AlterCommands.cpp:1373: DB::AlterCommands::validate(std::shared_ptr const&, std::shared_ptr) const @ 0x000000001c2513c1 8. /build/src/Interpreters/InterpreterAlterQuery.cpp:198: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001affa152 9. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff7cde 10. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 11. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 12. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 13. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 14. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 15. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 16. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 17. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 18. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 19. ? @ 0x00007f713a222ac3 20. ? @ 0x00007f713a2b4850 2024.12.16 10:52:22.009632 [ 3731 ] {e3006a93-e34b-4d49-85ca-58c2c83435fe} executeQuery: Code: 370. DB::Exception: Data type Nullable(Nothing) of column 'x' cannot be used in tables. (DATA_TYPE_CANNOT_BE_USED_IN_TABLES) (version 24.3.12.76.altinitystable) (from [::1]:60266) (comment: 03243_check_for_nullable_nothing_in_alter.sql) (in query: alter table v modify query select NULL as x from src;), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String const&) @ 0x000000000b49968c 6. /build/src/Storages/StorageFactory.cpp:30: DB::checkAllTypesAreAllowedInTable(DB::NamesAndTypesList const&) @ 0x000000001c36c1ab 7. /build/src/Storages/StorageMaterializedView.cpp:430: DB::StorageMaterializedView::alter(DB::AlterCommands const&, std::shared_ptr, std::unique_lock&) @ 0x000000001c428a31 8. /build/src/Interpreters/InterpreterAlterQuery.cpp:201: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001affa270 9. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff7cde 10. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 11. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 12. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 13. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 14. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 15. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 16. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 17. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 18. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 19. ? @ 0x00007f713a222ac3 20. ? @ 0x00007f713a2b4850 2024.12.16 10:52:22.029551 [ 3731 ] {e3006a93-e34b-4d49-85ca-58c2c83435fe} TCPHandler: Code: 370. DB::Exception: Data type Nullable(Nothing) of column 'x' cannot be used in tables. (DATA_TYPE_CANNOT_BE_USED_IN_TABLES), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String const&) @ 0x000000000b49968c 6. /build/src/Storages/StorageFactory.cpp:30: DB::checkAllTypesAreAllowedInTable(DB::NamesAndTypesList const&) @ 0x000000001c36c1ab 7. /build/src/Storages/StorageMaterializedView.cpp:430: DB::StorageMaterializedView::alter(DB::AlterCommands const&, std::shared_ptr, std::unique_lock&) @ 0x000000001c428a31 8. /build/src/Interpreters/InterpreterAlterQuery.cpp:201: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001affa270 9. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff7cde 10. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 11. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 12. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 13. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 14. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 15. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 16. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 17. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 18. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 19. ? @ 0x00007f713a222ac3 20. ? @ 0x00007f713a2b4850 2024.12.16 10:52:23.735788 [ 4098 ] {32ec77cf-3ea5-4f3a-a1fe-074300619992} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=2, jobs=2). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:60286) (comment: 00022_merge_prewhere.sql) (in query: SELECT count() FROM test.merge_hits WHERE AdvEngineID = 2;), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:748: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector, std::allocator>>&&, std::vector, std::allocator>>&&, std::shared_ptr, std::shared_ptr const&, DB::KeyCondition const&, std::optional const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, std::shared_ptr, unsigned long, std::vector>&, bool) @ 0x000000001cd10135 10. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1671: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector, std::allocator>>, std::vector, std::allocator>>, std::shared_ptr const&, DB::SelectQueryInfo const&, std::shared_ptr, unsigned long, std::shared_ptr, std::equal_to, std::allocator>>>, DB::MergeTreeData const&, std::vector> const&, std::shared_ptr, std::optional&) @ 0x000000001dd5ebc4 11. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1570: DB::ReadFromMergeTree::selectRangesToRead(std::vector, std::allocator>>, std::vector, std::allocator>>, std::shared_ptr const&, DB::SelectQueryInfo const&, std::shared_ptr, unsigned long, std::shared_ptr, std::equal_to, std::allocator>>>, DB::MergeTreeData const&, std::vector> const&, std::shared_ptr, std::optional&) @ 0x000000001dd5b86f 12. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1371: DB::ReadFromMergeTree::selectRangesToRead(std::vector, std::allocator>>, std::vector, std::allocator>>) const @ 0x000000001dd5b69e 13. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1854: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000001dd6148c 14. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1969: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd624fb 15. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector>, std::allocator>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd08c90 16. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3371f 17. /build/src/Storages/StorageMerge.cpp:1128: DB::ReadFromMerge::buildPipeline(DB::ReadFromMerge::ChildPlan&, DB::QueryProcessingStage::Enum) const @ 0x000000001c4455f0 18. /build/src/Storages/StorageMerge.cpp:451: DB::ReadFromMerge::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001c444bb6 19. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector>, std::allocator>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd08c90 20. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3371f 21. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b508741 22. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50849b 23. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 24. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 25. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 26. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 27. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 28. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 29. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 30. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 31. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 2024.12.16 10:52:24.104149 [ 3751 ] {c7123275-c7d0-4f69-9d1b-d0483cba24e2} Context: Server has databases (for example `test_01320`) with Ordinary engine, which was deprecated. To convert this database to the new Atomic engine, create a flag /var/lib/clickhouse/flags/convert_ordinary_to_atomic and make sure that ClickHouse has write permission for it. Example: sudo touch '/var/lib/clickhouse/flags/convert_ordinary_to_atomic' && sudo chmod 666 '/var/lib/clickhouse/flags/convert_ordinary_to_atomic' 2024.12.16 10:52:24.142984 [ 3553 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:296: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd2e93 21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set, std::equal_to, std::allocator>&) @ 0x000000001ccd371a 22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf3803a 23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d (version 24.3.12.76.altinitystable) 2024.12.16 10:52:24.483437 [ 4098 ] {32ec77cf-3ea5-4f3a-a1fe-074300619992} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=2, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:748: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector, std::allocator>>&&, std::vector, std::allocator>>&&, std::shared_ptr, std::shared_ptr const&, DB::KeyCondition const&, std::optional const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, std::shared_ptr, unsigned long, std::vector>&, bool) @ 0x000000001cd10135 10. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1671: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector, std::allocator>>, std::vector, std::allocator>>, std::shared_ptr const&, DB::SelectQueryInfo const&, std::shared_ptr, unsigned long, std::shared_ptr, std::equal_to, std::allocator>>>, DB::MergeTreeData const&, std::vector> const&, std::shared_ptr, std::optional&) @ 0x000000001dd5ebc4 11. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1570: DB::ReadFromMergeTree::selectRangesToRead(std::vector, std::allocator>>, std::vector, std::allocator>>, std::shared_ptr const&, DB::SelectQueryInfo const&, std::shared_ptr, unsigned long, std::shared_ptr, std::equal_to, std::allocator>>>, DB::MergeTreeData const&, std::vector> const&, std::shared_ptr, std::optional&) @ 0x000000001dd5b86f 12. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1371: DB::ReadFromMergeTree::selectRangesToRead(std::vector, std::allocator>>, std::vector, std::allocator>>) const @ 0x000000001dd5b69e 13. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1854: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000001dd6148c 14. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1969: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd624fb 15. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector>, std::allocator>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd08c90 16. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3371f 17. /build/src/Storages/StorageMerge.cpp:1128: DB::ReadFromMerge::buildPipeline(DB::ReadFromMerge::ChildPlan&, DB::QueryProcessingStage::Enum) const @ 0x000000001c4455f0 18. /build/src/Storages/StorageMerge.cpp:451: DB::ReadFromMerge::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001c444bb6 19. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector>, std::allocator>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd08c90 20. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3371f 21. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b508741 22. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50849b 23. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 24. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 25. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 26. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 27. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 28. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 29. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 30. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 31. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 2024.12.16 10:52:24.484851 [ 3741 ] {837fce71-7314-4ec2-8cac-ddd0b6fa7064} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=23, jobs=23): While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:39188) (comment: 00031_array_enumerate_uniq.sql) (in query: SELECT UserID, arrayEnumerateUniq(groupArray(SearchPhrase)) AS arr FROM ( SELECT UserID, SearchPhrase FROM test.hits WHERE CounterID = 1704509 AND UserID IN ( SELECT UserID FROM test.hits WHERE notEmpty(SearchPhrase) AND CounterID = 1704509 GROUP BY UserID HAVING count() > 1 ) ORDER BY UserID, WatchID ) WHERE notEmpty(SearchPhrase) GROUP BY UserID HAVING length(arr) > 1 ORDER BY UserID LIMIT 20 ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1fc91 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1fb3b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1faf0 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1fab0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1fa3b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce216d1 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1f750 16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future> DB::scheduleFromThreadPoolUnsafe, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl>&, String const&, Priority) @ 0x000000001ce1f09c 17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1d6c3 18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl>*, unsigned long) @ 0x000000001ce1d5b3 19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6eeac 20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, void, void>(std::allocator&, DB::MergeTreeMarksLoader*, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6edb5 21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int>(std::allocator, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6ece3 22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], std::shared_ptr&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, void>(std::allocator const&, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6eb95 23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, void>(std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6e49b 24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&, std::function const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bed3 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bbdd 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bb9d 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bb5d 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bb28 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd6a7e 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd2efd 31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fd02d6 2024.12.16 10:52:25.542540 [ 3741 ] {837fce71-7314-4ec2-8cac-ddd0b6fa7064} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=23, jobs=23): While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1fc91 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1fb3b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1faf0 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1fab0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1fa3b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce216d1 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1f750 16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future> DB::scheduleFromThreadPoolUnsafe, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl>&, String const&, Priority) @ 0x000000001ce1f09c 17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1d6c3 18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl>*, unsigned long) @ 0x000000001ce1d5b3 19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6eeac 20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, void, void>(std::allocator&, DB::MergeTreeMarksLoader*, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6edb5 21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int>(std::allocator, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6ece3 22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], std::shared_ptr&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, void>(std::allocator const&, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6eb95 23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, void>(std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6e49b 24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&, std::function const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bed3 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bbdd 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bb9d 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bb5d 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bb28 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd6a7e 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd2efd 31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fd02d6 2024.12.16 10:52:27.543638 [ 3479 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {fe54ed48-ddd9-4cf8-aa3b-418c81cf437c::202412_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=23, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1fc91 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1fb3b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1faf0 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1fab0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1fa3b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce216d1 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1f750 16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future> DB::scheduleFromThreadPoolUnsafe, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl>&, String const&, Priority) @ 0x000000001ce1f09c 17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1d6c3 18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl>*, unsigned long) @ 0x000000001ce1d5b3 19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*, unsigned long, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&&, unsigned long&&) @ 0x000000001ce56a2c 20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*, unsigned long, void, void>(std::allocator&, DB::MergeTreeMarksLoader*, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&&, unsigned long&&) @ 0x000000001ce56935 21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*, unsigned long>(std::allocator, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&&, unsigned long&&) @ 0x000000001ce56863 22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], std::shared_ptr&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*, unsigned long, void>(std::allocator const&, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&&, unsigned long&&) @ 0x000000001ce56715 23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*, unsigned long, void>(std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&&, unsigned long&&) @ 0x000000001ce53cbb 24. /build/src/Storages/MergeTree/MergeTreeReaderCompact.cpp:37: DB::MergeTreeReaderCompact::MergeTreeReaderCompact(std::shared_ptr, DB::NamesAndTypesList, std::unordered_map, std::equal_to, std::allocator>> const&, std::shared_ptr const&, DB::UncompressedCache*, DB::MarkCache*, DB::MarkRanges, DB::MergeTreeReaderSettings, std::map, std::allocator>>, std::function const&, int) @ 0x000000001ce51f0a 25. /build/src/Storages/MergeTree/MergeTreeReaderCompactSingleBuffer.h:16: DB::MergeTreeReaderCompactSingleBuffer::MergeTreeReaderCompactSingleBuffer&, DB::NamesAndTypesList const&, std::unordered_map, std::equal_to, std::allocator>> const&, std::shared_ptr const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map, std::allocator>> const&, std::function const&, int>(std::shared_ptr&, DB::NamesAndTypesList const&, std::unordered_map, std::equal_to, std::allocator>> const&, std::shared_ptr const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map, std::allocator>> const&, std::function const&, int&&) @ 0x000000001ccc27a5 26. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, DB::NamesAndTypesList const&, std::unordered_map, std::equal_to, std::allocator>> const&, std::shared_ptr const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map, std::allocator>> const&, std::function const&, int>(std::shared_ptr&, DB::NamesAndTypesList const&, std::unordered_map, std::equal_to, std::allocator>> const&, std::shared_ptr const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map, std::allocator>> const&, std::function const&, int&&) @ 0x000000001ccc1b7d 27. /build/src/Storages/MergeTree/MergeTreeDataPartCompact.cpp:43: DB::MergeTreeDataPartCompact::getReader(DB::NamesAndTypesList const&, std::shared_ptr const&, DB::MarkRanges const&, std::unordered_map, std::equal_to, std::allocator>> const&, DB::UncompressedCache*, DB::MarkCache*, std::shared_ptr const&, DB::MergeTreeReaderSettings const&, std::map, std::allocator>> const&, std::function const&) const @ 0x000000001ccbeef3 28. /build/src/Storages/MergeTree/MergeTreeSequentialSource.cpp:177: DB::MergeTreeSequentialSource::MergeTreeSequentialSource(DB::MergeTreeSequentialSourceType, DB::MergeTreeData const&, std::shared_ptr const&, std::shared_ptr, std::vector>, std::optional, bool, bool, bool, bool) @ 0x000000001ce71ef0 29. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeSequentialSource* std::construct_at[abi:v15000] const&, std::shared_ptr&, std::vector>&, std::optional, bool, bool&, bool&, bool&, DB::MergeTreeSequentialSource*>(DB::MergeTreeSequentialSource*, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr const&, std::shared_ptr&, std::vector>&, std::optional&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce76047 30. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000] const&, std::shared_ptr&, std::vector>&, std::optional, bool, bool&, bool&, bool&, void, void>(std::allocator&, DB::MergeTreeSequentialSource*, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr const&, std::shared_ptr&, std::vector>&, std::optional&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce75d04 31. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000] const&, std::shared_ptr&, std::vector>&, std::optional, bool, bool&, bool&, bool&>(std::allocator, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr const&, std::shared_ptr&, std::vector>&, std::optional&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce759b1 (version 24.3.12.76.altinitystable) 2024.12.16 10:52:28.335948 [ 3741 ] {89d4de55-bf6e-4694-91e5-b1fba0fb475c} executeQuery: Code: 60. DB::Exception: Table test_01320.r does not exist. (UNKNOWN_TABLE) (version 24.3.12.76.altinitystable) (from [::1]:60328) (comment: 01320_create_sync_race_condition_zookeeper.sh) (in query: SYSTEM SYNC REPLICA test_01320.r), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000a8f27cc 6. /build/src/Databases/IDatabase.cpp:37: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000001a145b72 7. /build/src/Interpreters/DatabaseCatalog.cpp:429: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000001a66ff96 8. /build/src/Interpreters/DatabaseCatalog.cpp:952: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000001a6752e3 9. /build/src/Interpreters/InterpreterSystemQuery.cpp:1113: DB::InterpreterSystemQuery::syncReplica(DB::ASTSystemQuery&) @ 0x000000001bbfc882 10. /build/src/Interpreters/InterpreterSystemQuery.cpp:670: DB::InterpreterSystemQuery::execute() @ 0x000000001bbf151d 11. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 12. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 13. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 20. ? @ 0x00007f713a222ac3 21. ? @ 0x00007f713a2b4850 2024.12.16 10:52:28.349713 [ 3741 ] {89d4de55-bf6e-4694-91e5-b1fba0fb475c} TCPHandler: Code: 60. DB::Exception: Table test_01320.r does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000a8f27cc 6. /build/src/Databases/IDatabase.cpp:37: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000001a145b72 7. /build/src/Interpreters/DatabaseCatalog.cpp:429: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000001a66ff96 8. /build/src/Interpreters/DatabaseCatalog.cpp:952: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000001a6752e3 9. /build/src/Interpreters/InterpreterSystemQuery.cpp:1113: DB::InterpreterSystemQuery::syncReplica(DB::ASTSystemQuery&) @ 0x000000001bbfc882 10. /build/src/Interpreters/InterpreterSystemQuery.cpp:670: DB::InterpreterSystemQuery::execute() @ 0x000000001bbf151d 11. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 12. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 13. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 20. ? @ 0x00007f713a222ac3 21. ? @ 0x00007f713a2b4850 2024.12.16 10:52:29.538020 [ 3740 ] {e2fba0b9-be72-4de7-a99a-2c117672d6ae} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=28, jobs=28). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:60336) (comment: 00001_count_hits.sql) (in query: SELECT count() FROM test.hits ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:52:30.102303 [ 3740 ] {e2fba0b9-be72-4de7-a99a-2c117672d6ae} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=28, jobs=28). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:52:30.919405 [ 3552 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:302: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf3a9cc 21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 (version 24.3.12.76.altinitystable) 2024.12.16 10:52:31.950113 [ 4182 ] {7244b64b-3eb3-41da-bca7-4f381b9840ab} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=2, jobs=2). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::ffff:127.0.0.1]:42018) (comment: 03232_pr_not_ready_set.sql) (in query: SELECT `__table1`.`query_id` AS `query_id` FROM `system`.`query_log` AS `__table1` WHERE (`__table1`.`current_database` = _CAST('test_ml5uilo7', 'String')) AND (`__table1`.`event_date` >= _CAST(20072, 'Date')) AND (`__table1`.`type` = 'QueryFinish') AND (`__table1`.`query` LIKE '-- Parallel inner query alone%')), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:748: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector, std::allocator>>&&, std::vector, std::allocator>>&&, std::shared_ptr, std::shared_ptr const&, DB::KeyCondition const&, std::optional const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, std::shared_ptr, unsigned long, std::vector>&, bool) @ 0x000000001cd10135 10. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1671: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector, std::allocator>>, std::vector, std::allocator>>, std::shared_ptr const&, DB::SelectQueryInfo const&, std::shared_ptr, unsigned long, std::shared_ptr, std::equal_to, std::allocator>>>, DB::MergeTreeData const&, std::vector> const&, std::shared_ptr, std::optional&) @ 0x000000001dd5ebc4 11. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1570: DB::ReadFromMergeTree::selectRangesToRead(std::vector, std::allocator>>, std::vector, std::allocator>>, std::shared_ptr const&, DB::SelectQueryInfo const&, std::shared_ptr, unsigned long, std::shared_ptr, std::equal_to, std::allocator>>>, DB::MergeTreeData const&, std::vector> const&, std::shared_ptr, std::optional&) @ 0x000000001dd5b86f 12. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1371: DB::ReadFromMergeTree::selectRangesToRead(std::vector, std::allocator>>, std::vector, std::allocator>>) const @ 0x000000001dd5b69e 13. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1854: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000001dd6148c 14. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1969: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd624fb 15. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector>, std::allocator>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd08c90 16. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3371f 17. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b508741 18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50849b 19. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 20. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 21. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 22. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 23. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 24. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 25. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 26. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 27. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 28. ? @ 0x00007f713a222ac3 29. ? @ 0x00007f713a2b4850 2024.12.16 10:52:31.975936 [ 4182 ] {7244b64b-3eb3-41da-bca7-4f381b9840ab} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=2, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:748: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector, std::allocator>>&&, std::vector, std::allocator>>&&, std::shared_ptr, std::shared_ptr const&, DB::KeyCondition const&, std::optional const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, std::shared_ptr, unsigned long, std::vector>&, bool) @ 0x000000001cd10135 10. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1671: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector, std::allocator>>, std::vector, std::allocator>>, std::shared_ptr const&, DB::SelectQueryInfo const&, std::shared_ptr, unsigned long, std::shared_ptr, std::equal_to, std::allocator>>>, DB::MergeTreeData const&, std::vector> const&, std::shared_ptr, std::optional&) @ 0x000000001dd5ebc4 11. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1570: DB::ReadFromMergeTree::selectRangesToRead(std::vector, std::allocator>>, std::vector, std::allocator>>, std::shared_ptr const&, DB::SelectQueryInfo const&, std::shared_ptr, unsigned long, std::shared_ptr, std::equal_to, std::allocator>>>, DB::MergeTreeData const&, std::vector> const&, std::shared_ptr, std::optional&) @ 0x000000001dd5b86f 12. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1371: DB::ReadFromMergeTree::selectRangesToRead(std::vector, std::allocator>>, std::vector, std::allocator>>) const @ 0x000000001dd5b69e 13. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1854: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000001dd6148c 14. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1969: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd624fb 15. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector>, std::allocator>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd08c90 16. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3371f 17. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b508741 18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50849b 19. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 20. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 21. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 22. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 23. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 24. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 25. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 26. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 27. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 28. ? @ 0x00007f713a222ac3 29. ? @ 0x00007f713a2b4850 2024.12.16 10:52:32.603935 [ 4098 ] {b117fcf1-8b7c-41e5-a75c-2cd4180d1d3c} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=23, jobs=6): While executing MergeTreeSelect(pool: ReadPoolParallelReplicas, algorithm: Thread). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::ffff:127.0.0.1]:38928) (comment: 03232_pr_not_ready_set.sql) (in query: SELECT `__table1`.`query_id` AS `query_id` FROM `system`.`query_log` AS `__table1` WHERE (`__table1`.`current_database` = _CAST('test_ml5uilo7', 'String')) AND (`__table1`.`event_date` >= _CAST(20072, 'Date')) AND (`__table1`.`type` = 'QueryFinish') AND (`__table1`.`query` LIKE '-- Parallel inner query alone%')), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1fc91 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1fb3b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1faf0 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1fab0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1fa3b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce216d1 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1f750 16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future> DB::scheduleFromThreadPoolUnsafe, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl>&, String const&, Priority) @ 0x000000001ce1f09c 17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1d6c3 18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl>*, unsigned long) @ 0x000000001ce1d5b3 19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*, unsigned long, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&&, unsigned long&&) @ 0x000000001ce56a2c 20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*, unsigned long, void, void>(std::allocator&, DB::MergeTreeMarksLoader*, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&&, unsigned long&&) @ 0x000000001ce56935 21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*, unsigned long>(std::allocator, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&&, unsigned long&&) @ 0x000000001ce56863 22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], std::shared_ptr&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*, unsigned long, void>(std::allocator const&, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&&, unsigned long&&) @ 0x000000001ce56715 23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*, unsigned long, void>(std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&&, unsigned long&&) @ 0x000000001ce53cbb 24. /build/src/Storages/MergeTree/MergeTreeReaderCompact.cpp:37: DB::MergeTreeReaderCompact::MergeTreeReaderCompact(std::shared_ptr, DB::NamesAndTypesList, std::unordered_map, std::equal_to, std::allocator>> const&, std::shared_ptr const&, DB::UncompressedCache*, DB::MarkCache*, DB::MarkRanges, DB::MergeTreeReaderSettings, std::map, std::allocator>>, std::function const&, int) @ 0x000000001ce51f0a 25. /build/src/Storages/MergeTree/MergeTreeReaderCompactSingleBuffer.h:16: DB::MergeTreeReaderCompactSingleBuffer::MergeTreeReaderCompactSingleBuffer&, DB::NamesAndTypesList const&, std::unordered_map, std::equal_to, std::allocator>> const&, std::shared_ptr const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map, std::allocator>> const&, std::function const&, int>(std::shared_ptr&, DB::NamesAndTypesList const&, std::unordered_map, std::equal_to, std::allocator>> const&, std::shared_ptr const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map, std::allocator>> const&, std::function const&, int&&) @ 0x000000001ccc27a5 26. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, DB::NamesAndTypesList const&, std::unordered_map, std::equal_to, std::allocator>> const&, std::shared_ptr const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map, std::allocator>> const&, std::function const&, int>(std::shared_ptr&, DB::NamesAndTypesList const&, std::unordered_map, std::equal_to, std::allocator>> const&, std::shared_ptr const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map, std::allocator>> const&, std::function const&, int&&) @ 0x000000001ccc1b7d 27. /build/src/Storages/MergeTree/MergeTreeDataPartCompact.cpp:43: DB::MergeTreeDataPartCompact::getReader(DB::NamesAndTypesList const&, std::shared_ptr const&, DB::MarkRanges const&, std::unordered_map, std::equal_to, std::allocator>> const&, DB::UncompressedCache*, DB::MarkCache*, std::shared_ptr const&, DB::MergeTreeReaderSettings const&, std::map, std::allocator>> const&, std::function const&) const @ 0x000000001ccbeef3 28. /build/src/Storages/MergeTree/MergeTreeReadTask.cpp:44: DB::MergeTreeReadTask::createReaders(std::shared_ptr const&, DB::MergeTreeReadTask::Extras const&, DB::MarkRanges const&)::$_0::operator()(DB::NamesAndTypesList const&) const @ 0x000000001ce987a7 29. /build/src/Storages/MergeTree/MergeTreeReadTask.cpp:64: DB::MergeTreeReadTask::createReaders(std::shared_ptr const&, DB::MergeTreeReadTask::Extras const&, DB::MarkRanges const&) @ 0x000000001ce985f5 30. /build/src/Storages/MergeTree/MergeTreeReadPoolBase.cpp:160: DB::MergeTreeReadPoolBase::createTask(std::shared_ptr, DB::MarkRanges, DB::MergeTreeReadTask*) const @ 0x000000001ddaa6ea 31. /build/src/Storages/MergeTree/MergeTreeReadPoolParallelReplicas.cpp:103: DB::MergeTreeReadPoolParallelReplicas::getTask(unsigned long, DB::MergeTreeReadTask*) @ 0x000000001ddd71b2 2024.12.16 10:52:32.673259 [ 4098 ] {b117fcf1-8b7c-41e5-a75c-2cd4180d1d3c} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=23, jobs=6): While executing MergeTreeSelect(pool: ReadPoolParallelReplicas, algorithm: Thread). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1fc91 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1fb3b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1faf0 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1fab0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1fa3b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce216d1 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1f750 16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future> DB::scheduleFromThreadPoolUnsafe, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl>&, String const&, Priority) @ 0x000000001ce1f09c 17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1d6c3 18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl>*, unsigned long) @ 0x000000001ce1d5b3 19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*, unsigned long, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&&, unsigned long&&) @ 0x000000001ce56a2c 20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*, unsigned long, void, void>(std::allocator&, DB::MergeTreeMarksLoader*, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&&, unsigned long&&) @ 0x000000001ce56935 21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*, unsigned long>(std::allocator, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&&, unsigned long&&) @ 0x000000001ce56863 22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], std::shared_ptr&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*, unsigned long, void>(std::allocator const&, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&&, unsigned long&&) @ 0x000000001ce56715 23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*, unsigned long, void>(std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&&, unsigned long&&) @ 0x000000001ce53cbb 24. /build/src/Storages/MergeTree/MergeTreeReaderCompact.cpp:37: DB::MergeTreeReaderCompact::MergeTreeReaderCompact(std::shared_ptr, DB::NamesAndTypesList, std::unordered_map, std::equal_to, std::allocator>> const&, std::shared_ptr const&, DB::UncompressedCache*, DB::MarkCache*, DB::MarkRanges, DB::MergeTreeReaderSettings, std::map, std::allocator>>, std::function const&, int) @ 0x000000001ce51f0a 25. /build/src/Storages/MergeTree/MergeTreeReaderCompactSingleBuffer.h:16: DB::MergeTreeReaderCompactSingleBuffer::MergeTreeReaderCompactSingleBuffer&, DB::NamesAndTypesList const&, std::unordered_map, std::equal_to, std::allocator>> const&, std::shared_ptr const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map, std::allocator>> const&, std::function const&, int>(std::shared_ptr&, DB::NamesAndTypesList const&, std::unordered_map, std::equal_to, std::allocator>> const&, std::shared_ptr const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map, std::allocator>> const&, std::function const&, int&&) @ 0x000000001ccc27a5 26. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, DB::NamesAndTypesList const&, std::unordered_map, std::equal_to, std::allocator>> const&, std::shared_ptr const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map, std::allocator>> const&, std::function const&, int>(std::shared_ptr&, DB::NamesAndTypesList const&, std::unordered_map, std::equal_to, std::allocator>> const&, std::shared_ptr const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map, std::allocator>> const&, std::function const&, int&&) @ 0x000000001ccc1b7d 27. /build/src/Storages/MergeTree/MergeTreeDataPartCompact.cpp:43: DB::MergeTreeDataPartCompact::getReader(DB::NamesAndTypesList const&, std::shared_ptr const&, DB::MarkRanges const&, std::unordered_map, std::equal_to, std::allocator>> const&, DB::UncompressedCache*, DB::MarkCache*, std::shared_ptr const&, DB::MergeTreeReaderSettings const&, std::map, std::allocator>> const&, std::function const&) const @ 0x000000001ccbeef3 28. /build/src/Storages/MergeTree/MergeTreeReadTask.cpp:44: DB::MergeTreeReadTask::createReaders(std::shared_ptr const&, DB::MergeTreeReadTask::Extras const&, DB::MarkRanges const&)::$_0::operator()(DB::NamesAndTypesList const&) const @ 0x000000001ce987a7 29. /build/src/Storages/MergeTree/MergeTreeReadTask.cpp:64: DB::MergeTreeReadTask::createReaders(std::shared_ptr const&, DB::MergeTreeReadTask::Extras const&, DB::MarkRanges const&) @ 0x000000001ce985f5 30. /build/src/Storages/MergeTree/MergeTreeReadPoolBase.cpp:160: DB::MergeTreeReadPoolBase::createTask(std::shared_ptr, DB::MarkRanges, DB::MergeTreeReadTask*) const @ 0x000000001ddaa6ea 31. /build/src/Storages/MergeTree/MergeTreeReadPoolParallelReplicas.cpp:103: DB::MergeTreeReadPoolParallelReplicas::getTask(unsigned long, DB::MergeTreeReadTask*) @ 0x000000001ddd71b2 2024.12.16 10:52:33.044388 [ 4098 ] {} ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:38928). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x00000000134e6f2c 6. /build/src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x00000000134e60a0 7. /build/src/IO/ReadBuffer.h:70: DB::ReadBuffer::next() @ 0x000000000af5ec6a 8. /build/src/IO/ReadBuffer.h:106: DB::TCPHandler::runImpl() @ 0x000000001d46ea77 9. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 10. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 11. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 12. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 13. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 14. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 15. ? @ 0x00007f713a222ac3 16. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 10:52:33.084921 [ 3732 ] {4990a216-bd86-480e-9441-c360b9bfe7e0} executeQuery: Code: 439. DB::Exception: Received from 127.0.0.3:9000. DB::Exception: Cannot schedule a task: fault injected (threads=2, jobs=2). Stack trace: 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:748: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector, std::allocator>>&&, std::vector, std::allocator>>&&, std::shared_ptr, std::shared_ptr const&, DB::KeyCondition const&, std::optional const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, std::shared_ptr, unsigned long, std::vector>&, bool) @ 0x000000001cd10135 10. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1671: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector, std::allocator>>, std::vector, std::allocator>>, std::shared_ptr const&, DB::SelectQueryInfo const&, std::shared_ptr, unsigned long, std::shared_ptr, std::equal_to, std::allocator>>>, DB::MergeTreeData const&, std::vector> const&, std::shared_ptr, std::optional&) @ 0x000000001dd5ebc4 11. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1570: DB::ReadFromMergeTree::selectRangesToRead(std::vector, std::allocator>>, std::vector, std::allocator>>, std::shared_ptr const&, DB::SelectQueryInfo const&, std::shared_ptr, unsigned long, std::shared_ptr, std::equal_to, std::allocator>>>, DB::MergeTreeData const&, std::vector> const&, std::shared_ptr, std::optional&) @ 0x000000001dd5b86f 12. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1371: DB::ReadFromMergeTree::selectRangesToRead(std::vector, std::allocator>>, std::vector, std::allocator>>) const @ 0x000000001dd5b69e 13. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1854: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000001dd6148c 14. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1969: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd624fb 15. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector>, std::allocator>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd08c90 16. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3371f 17. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b508741 18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50849b 19. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 20. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 21. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 22. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 23. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 24. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 25. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 26. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 27. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 28. ? @ 0x00007f713a222ac3 29. ? @ 0x00007f713a2b4850 : While executing Remote. (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:60304) (comment: 03232_pr_not_ready_set.sql) (in query: SELECT is_initial_query, count() AS c, replaceRegexpAll(query, '_data_(\\d+)_(\\d+)', '_data_') AS query FROM system.query_log WHERE (event_date >= yesterday()) AND (type = 'QueryFinish') AND (ignore(54, 0, ignore('QueryFinish', 11, toLowCardinality(toLowCardinality(11)), 11, 11, 11), 'QueryFinish', materialize(11), toUInt128(11)) IN ( SELECT query_id FROM system.query_log WHERE (current_database = currentDatabase()) AND (event_date >= yesterday()) AND (type = 'QueryFinish') AND (query LIKE '-- Parallel inner query alone%') )) GROUP BY is_initial_query, query ORDER BY is_initial_query ASC, c ASC, query ASC SETTINGS allow_experimental_parallel_reading_from_replicas=1, max_parallel_replicas=3, cluster_for_parallel_replicas='test_cluster_one_shard_three_replicas_localhost', parallel_replicas_for_non_replicated_merge_tree=1, parallel_replicas_min_number_of_rows_per_replica=10;), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:89: DB::Exception::Exception(String const&, int, bool) @ 0x000000000a942caa 5. /build/src/Common/Exception.h:97: DB::Exception::createDeprecated(String const&, int, bool) @ 0x000000000a942c55 6. /build/src/IO/ReadHelpers.cpp:1560: DB::readException(DB::ReadBuffer&, String const&, bool) @ 0x0000000013369f82 7. /build/src/Client/Connection.cpp:1233: DB::Connection::receiveException() const @ 0x000000001d2bdc59 8. /build/src/Client/Connection.cpp:1070: DB::Connection::receivePacket() @ 0x000000001d2c51b1 9. /build/src/Client/MultiplexedConnections.cpp:339: DB::MultiplexedConnections::receivePacketUnlocked(std::function) @ 0x000000001d32a278 10. /build/src/QueryPipeline/RemoteQueryExecutorReadContext.cpp:50: DB::RemoteQueryExecutorReadContext::Task::run(std::function, std::function) @ 0x0000000019ebf331 11. /build/src/Common/AsyncTaskExecutor.cpp:88: DB::AsyncTaskExecutor::Routine::operator()(std::function) @ 0x0000000019ebde69 12. /build/src/Common/Fiber.h:76: Fiber::RoutineImpl::operator()(boost::context::fiber&&) @ 0x0000000019ebdd78 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019ebdd08 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:531: ? @ 0x0000000019ebdcc8 15. /build/contrib/boost/boost/context/fiber_fcontext.hpp:157: boost::context::detail::fiber_record>::run(void*) @ 0x0000000019ebdbfe 16. /build/contrib/boost/boost/context/fiber_fcontext.hpp:97: void boost::context::detail::fiber_entry>>(boost::context::detail::transfer_t) @ 0x0000000019ebd91d 2024.12.16 10:52:33.087408 [ 4187 ] {bedb6f39-aa1a-48b4-adc4-da747c4fafac} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=1, jobs=1). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:46076) (comment: 00864_union_all_supertype.sql) (in query: select key, s1.value, s2.value from ( select 'key1' as key, 'value1' as value ) s1 all left join ( select 'key1' as key, '' as value union all select 'key2' as key, toNullable('') as value ) s2 using key;), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:52:33.113277 [ 4187 ] {bedb6f39-aa1a-48b4-adc4-da747c4fafac} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=1, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:52:33.130940 [ 3732 ] {4990a216-bd86-480e-9441-c360b9bfe7e0} TCPHandler: Code: 439. DB::Exception: Received from 127.0.0.3:9000. DB::Exception: Cannot schedule a task: fault injected (threads=2, jobs=2). Stack trace: 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:748: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector, std::allocator>>&&, std::vector, std::allocator>>&&, std::shared_ptr, std::shared_ptr const&, DB::KeyCondition const&, std::optional const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, std::shared_ptr, unsigned long, std::vector>&, bool) @ 0x000000001cd10135 10. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1671: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector, std::allocator>>, std::vector, std::allocator>>, std::shared_ptr const&, DB::SelectQueryInfo const&, std::shared_ptr, unsigned long, std::shared_ptr, std::equal_to, std::allocator>>>, DB::MergeTreeData const&, std::vector> const&, std::shared_ptr, std::optional&) @ 0x000000001dd5ebc4 11. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1570: DB::ReadFromMergeTree::selectRangesToRead(std::vector, std::allocator>>, std::vector, std::allocator>>, std::shared_ptr const&, DB::SelectQueryInfo const&, std::shared_ptr, unsigned long, std::shared_ptr, std::equal_to, std::allocator>>>, DB::MergeTreeData const&, std::vector> const&, std::shared_ptr, std::optional&) @ 0x000000001dd5b86f 12. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1371: DB::ReadFromMergeTree::selectRangesToRead(std::vector, std::allocator>>, std::vector, std::allocator>>) const @ 0x000000001dd5b69e 13. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1854: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000001dd6148c 14. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1969: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd624fb 15. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector>, std::allocator>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd08c90 16. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3371f 17. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b508741 18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50849b 19. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 20. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 21. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 22. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 23. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 24. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 25. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 26. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 27. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 28. ? @ 0x00007f713a222ac3 29. ? @ 0x00007f713a2b4850 : While executing Remote. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:89: DB::Exception::Exception(String const&, int, bool) @ 0x000000000a942caa 5. /build/src/Common/Exception.h:97: DB::Exception::createDeprecated(String const&, int, bool) @ 0x000000000a942c55 6. /build/src/IO/ReadHelpers.cpp:1560: DB::readException(DB::ReadBuffer&, String const&, bool) @ 0x0000000013369f82 7. /build/src/Client/Connection.cpp:1233: DB::Connection::receiveException() const @ 0x000000001d2bdc59 8. /build/src/Client/Connection.cpp:1070: DB::Connection::receivePacket() @ 0x000000001d2c51b1 9. /build/src/Client/MultiplexedConnections.cpp:339: DB::MultiplexedConnections::receivePacketUnlocked(std::function) @ 0x000000001d32a278 10. /build/src/QueryPipeline/RemoteQueryExecutorReadContext.cpp:50: DB::RemoteQueryExecutorReadContext::Task::run(std::function, std::function) @ 0x0000000019ebf331 11. /build/src/Common/AsyncTaskExecutor.cpp:88: DB::AsyncTaskExecutor::Routine::operator()(std::function) @ 0x0000000019ebde69 12. /build/src/Common/Fiber.h:76: Fiber::RoutineImpl::operator()(boost::context::fiber&&) @ 0x0000000019ebdd78 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019ebdd08 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:531: ? @ 0x0000000019ebdcc8 15. /build/contrib/boost/boost/context/fiber_fcontext.hpp:157: boost::context::detail::fiber_record>::run(void*) @ 0x0000000019ebdbfe 16. /build/contrib/boost/boost/context/fiber_fcontext.hpp:97: void boost::context::detail::fiber_entry>>(boost::context::detail::transfer_t) @ 0x0000000019ebd91d 2024.12.16 10:52:33.567700 [ 3553 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:310: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf3ab86 21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 (version 24.3.12.76.altinitystable) 2024.12.16 10:52:35.431316 [ 3865 ] {32b411bd-9089-4606-a4bc-00873cdfcf51} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=1). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:46112) (comment: 00071_merge_tree_optimize_aio.sql) (in query: CREATE TABLE test.hits_snippet(EventTime DateTime('Asia/Dubai'), EventDate Date, CounterID UInt32, UserID UInt64, URL String, Referer String) ENGINE = MergeTree(EventDate, intHash32(UserID), (CounterID, EventDate, intHash32(UserID), EventTime), 8192);), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/IO/WriteBufferFromFileDecorator.cpp:0: DB::WriteBufferFromFileDecorator::finalizeImpl() @ 0x000000001a358847 21. /build/src/Disks/IO/WriteBufferWithFinalizeCallback.cpp:18: DB::WriteBufferWithFinalizeCallback::finalizeImpl() @ 0x000000001a3585b9 22. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 23. /build/src/Storages/MergeTree/MergeTreeData.cpp:306: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x000000001cbadd42 24. /build/src/Storages/StorageMergeTree.cpp:117: DB::StorageMergeTree::StorageMergeTree(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, DB::LoadingStrictnessLevel, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>) @ 0x000000001d0eb1d1 25. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageMergeTree* std::construct_at[abi:v15000]&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, DB::StorageMergeTree*>(DB::StorageMergeTree*, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&) @ 0x000000001d0eabb7 26. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000]&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, void, void>(std::allocator&, DB::StorageMergeTree*, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&) @ 0x000000001d0ea8c7 27. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000]&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>>(std::allocator, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&) @ 0x000000001d0ea575 28. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, void>(std::allocator const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&) @ 0x000000001d0ea3a7 29. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000]&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, void>(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&) @ 0x000000001d0e756d 30. /build/src/Storages/MergeTree/registerStorageMergeTree.cpp:741: DB::create(DB::StorageFactory::Arguments const&) @ 0x000000001d0e50aa 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019307efd 2024.12.16 10:52:35.472014 [ 3865 ] {32b411bd-9089-4606-a4bc-00873cdfcf51} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/IO/WriteBufferFromFileDecorator.cpp:0: DB::WriteBufferFromFileDecorator::finalizeImpl() @ 0x000000001a358847 21. /build/src/Disks/IO/WriteBufferWithFinalizeCallback.cpp:18: DB::WriteBufferWithFinalizeCallback::finalizeImpl() @ 0x000000001a3585b9 22. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 23. /build/src/Storages/MergeTree/MergeTreeData.cpp:306: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x000000001cbadd42 24. /build/src/Storages/StorageMergeTree.cpp:117: DB::StorageMergeTree::StorageMergeTree(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, DB::LoadingStrictnessLevel, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>) @ 0x000000001d0eb1d1 25. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageMergeTree* std::construct_at[abi:v15000]&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, DB::StorageMergeTree*>(DB::StorageMergeTree*, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&) @ 0x000000001d0eabb7 26. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000]&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, void, void>(std::allocator&, DB::StorageMergeTree*, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&) @ 0x000000001d0ea8c7 27. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000]&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>>(std::allocator, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&) @ 0x000000001d0ea575 28. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, void>(std::allocator const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&) @ 0x000000001d0ea3a7 29. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000]&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, void>(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&) @ 0x000000001d0e756d 30. /build/src/Storages/MergeTree/registerStorageMergeTree.cpp:741: DB::create(DB::StorageFactory::Arguments const&) @ 0x000000001d0e50aa 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019307efd 2024.12.16 10:52:35.786946 [ 3868 ] {31e40b7d-27d1-4854-bbf8-587901b1cbf8} executeQuery: Code: 252. DB::Exception: Too many parts (3 with average size of 266.00 B) in table 'test_bfdt4ca7.test (bac16db1-65a2-4ad6-b198-fe1f605b33ce)'. Merges are processing significantly slower than inserts. (TOO_MANY_PARTS) (version 24.3.12.76.altinitystable) (from [::1]:46092) (comment: 02458_relax_too_many_parts.sql) (in query: INSERT INTO test VALUES ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, unsigned long&, ReadableSize&&, String&&) @ 0x000000001cc51a28 6. /build/src/Storages/MergeTree/MergeTreeData.cpp:4450: DB::MergeTreeData::delayInsertOrThrowIfNeeded(Poco::Event*, std::shared_ptr const&, bool) const @ 0x000000001cc033a4 7. /build/src/Storages/MergeTree/MergeTreeSink.cpp:50: DB::MergeTreeSink::onStart() @ 0x000000001d13a96c 8. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:136: DB::ExceptionKeepingTransform::work()::$_0::operator()() const @ 0x000000001da419b9 9. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41995 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41975 11. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41955 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4191d 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 15. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:114: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x000000001da4145a 16. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:136: DB::ExceptionKeepingTransform::work() @ 0x000000001da40d35 17. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 18. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 19. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 20. /build/src/Processors/Executors/PipelineExecutor.cpp:148: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x000000001d51599e 21. /build/src/Processors/Executors/PushingPipelineExecutor.cpp:93: DB::PushingPipelineExecutor::start() @ 0x000000001d5417fc 22. /build/src/Server/TCPHandler.cpp:906: auto DB::TCPHandler::processInsertQuery()::$_0::operator()(DB::PushingPipelineExecutor&, DB::Block) const @ 0x000000001d47d9d5 23. /build/src/Server/TCPHandler.cpp:987: DB::TCPHandler::processInsertQuery() @ 0x000000001d47aa2a 24. /build/src/Server/TCPHandler.cpp:534: DB::TCPHandler::runImpl() @ 0x000000001d46ff31 25. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 26. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 27. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 28. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 29. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 30. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 31. ? @ 0x00007f713a222ac3 2024.12.16 10:52:35.797726 [ 3868 ] {31e40b7d-27d1-4854-bbf8-587901b1cbf8} TCPHandler: Code: 252. DB::Exception: Too many parts (3 with average size of 266.00 B) in table 'test_bfdt4ca7.test (bac16db1-65a2-4ad6-b198-fe1f605b33ce)'. Merges are processing significantly slower than inserts. (TOO_MANY_PARTS), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, unsigned long&, ReadableSize&&, String&&) @ 0x000000001cc51a28 6. /build/src/Storages/MergeTree/MergeTreeData.cpp:4450: DB::MergeTreeData::delayInsertOrThrowIfNeeded(Poco::Event*, std::shared_ptr const&, bool) const @ 0x000000001cc033a4 7. /build/src/Storages/MergeTree/MergeTreeSink.cpp:50: DB::MergeTreeSink::onStart() @ 0x000000001d13a96c 8. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:136: DB::ExceptionKeepingTransform::work()::$_0::operator()() const @ 0x000000001da419b9 9. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41995 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41975 11. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41955 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4191d 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 15. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:114: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x000000001da4145a 16. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:136: DB::ExceptionKeepingTransform::work() @ 0x000000001da40d35 17. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 18. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 19. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 20. /build/src/Processors/Executors/PipelineExecutor.cpp:148: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x000000001d51599e 21. /build/src/Processors/Executors/PushingPipelineExecutor.cpp:93: DB::PushingPipelineExecutor::start() @ 0x000000001d5417fc 22. /build/src/Server/TCPHandler.cpp:906: auto DB::TCPHandler::processInsertQuery()::$_0::operator()(DB::PushingPipelineExecutor&, DB::Block) const @ 0x000000001d47d9d5 23. /build/src/Server/TCPHandler.cpp:987: DB::TCPHandler::processInsertQuery() @ 0x000000001d47aa2a 24. /build/src/Server/TCPHandler.cpp:534: DB::TCPHandler::runImpl() @ 0x000000001d46ff31 25. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 26. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 27. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 28. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 29. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 30. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 31. ? @ 0x00007f713a222ac3 2024.12.16 10:52:36.272004 [ 3482 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {41d82839-5472-4425-b891-a2dc2a236577::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=5, jobs=0): (while reading column StartTime): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/41d/41d82839-5472-4425-b891-a2dc2a236577/201403_3_3_0/ in table test.visits (41d82839-5472-4425-b891-a2dc2a236577) located on disk s3_disk of type s3, from mark 1 with max_rows_to_read = 6608): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe(ThreadPoolImpl>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e92e1 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e917b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e9130 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e90f0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e907b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190eadb1 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e8d90 16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future DB::scheduleFromThreadPoolUnsafe(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl>&, String const&, Priority) @ 0x00000000190e861c 17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e7e3f 18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019365312 19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936561e 20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddc44d 21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6d168 22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6cfbd 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6cf7d 24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6cf3d 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6cf08 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd6a7e 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd2efd 28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fd02d6 29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x0000000019fd045c 30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&) @ 0x000000001ce6ab9b 31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce6a910 (version 24.3.12.76.altinitystable) 2024.12.16 10:52:37.304313 [ 3545 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::PartLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:323: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf3ae44 21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 (version 24.3.12.76.altinitystable) 2024.12.16 10:52:38.372987 [ 3481 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {543b302c-96aa-4ec0-9035-9e47ab548ac9::202412_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=23, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1fc91 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1fb3b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1faf0 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1fab0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1fa3b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce216d1 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1f750 16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future> DB::scheduleFromThreadPoolUnsafe, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl>&, String const&, Priority) @ 0x000000001ce1f09c 17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1d6c3 18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl>*, unsigned long) @ 0x000000001ce1d5b3 19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*, unsigned long, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&&, unsigned long&&) @ 0x000000001ce56a2c 20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*, unsigned long, void, void>(std::allocator&, DB::MergeTreeMarksLoader*, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&&, unsigned long&&) @ 0x000000001ce56935 21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*, unsigned long>(std::allocator, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&&, unsigned long&&) @ 0x000000001ce56863 22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], std::shared_ptr&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*, unsigned long, void>(std::allocator const&, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&&, unsigned long&&) @ 0x000000001ce56715 23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*, unsigned long, void>(std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&&, unsigned long&&) @ 0x000000001ce53cbb 24. /build/src/Storages/MergeTree/MergeTreeReaderCompact.cpp:37: DB::MergeTreeReaderCompact::MergeTreeReaderCompact(std::shared_ptr, DB::NamesAndTypesList, std::unordered_map, std::equal_to, std::allocator>> const&, std::shared_ptr const&, DB::UncompressedCache*, DB::MarkCache*, DB::MarkRanges, DB::MergeTreeReaderSettings, std::map, std::allocator>>, std::function const&, int) @ 0x000000001ce51f0a 25. /build/src/Storages/MergeTree/MergeTreeReaderCompactSingleBuffer.h:16: DB::MergeTreeReaderCompactSingleBuffer::MergeTreeReaderCompactSingleBuffer&, DB::NamesAndTypesList const&, std::unordered_map, std::equal_to, std::allocator>> const&, std::shared_ptr const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map, std::allocator>> const&, std::function const&, int>(std::shared_ptr&, DB::NamesAndTypesList const&, std::unordered_map, std::equal_to, std::allocator>> const&, std::shared_ptr const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map, std::allocator>> const&, std::function const&, int&&) @ 0x000000001ccc27a5 26. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, DB::NamesAndTypesList const&, std::unordered_map, std::equal_to, std::allocator>> const&, std::shared_ptr const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map, std::allocator>> const&, std::function const&, int>(std::shared_ptr&, DB::NamesAndTypesList const&, std::unordered_map, std::equal_to, std::allocator>> const&, std::shared_ptr const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map, std::allocator>> const&, std::function const&, int&&) @ 0x000000001ccc1b7d 27. /build/src/Storages/MergeTree/MergeTreeDataPartCompact.cpp:43: DB::MergeTreeDataPartCompact::getReader(DB::NamesAndTypesList const&, std::shared_ptr const&, DB::MarkRanges const&, std::unordered_map, std::equal_to, std::allocator>> const&, DB::UncompressedCache*, DB::MarkCache*, std::shared_ptr const&, DB::MergeTreeReaderSettings const&, std::map, std::allocator>> const&, std::function const&) const @ 0x000000001ccbeef3 28. /build/src/Storages/MergeTree/MergeTreeSequentialSource.cpp:177: DB::MergeTreeSequentialSource::MergeTreeSequentialSource(DB::MergeTreeSequentialSourceType, DB::MergeTreeData const&, std::shared_ptr const&, std::shared_ptr, std::vector>, std::optional, bool, bool, bool, bool) @ 0x000000001ce71ef0 29. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeSequentialSource* std::construct_at[abi:v15000] const&, std::shared_ptr&, std::vector>&, std::optional, bool, bool&, bool&, bool&, DB::MergeTreeSequentialSource*>(DB::MergeTreeSequentialSource*, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr const&, std::shared_ptr&, std::vector>&, std::optional&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce76047 30. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000] const&, std::shared_ptr&, std::vector>&, std::optional, bool, bool&, bool&, bool&, void, void>(std::allocator&, DB::MergeTreeSequentialSource*, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr const&, std::shared_ptr&, std::vector>&, std::optional&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce75d04 31. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000] const&, std::shared_ptr&, std::vector>&, std::optional, bool, bool&, bool&, bool&>(std::allocator, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr const&, std::shared_ptr&, std::vector>&, std::optional&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce759b1 (version 24.3.12.76.altinitystable) 2024.12.16 10:52:40.542947 [ 3732 ] {d25c7880-9cc5-4ce8-93dd-26bdd38b6309} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:44752) (comment: 00072_compare_date_and_string_index.sql) (in query: SELECT count() FROM test.hits WHERE EventDate = '2014-03-18';), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:748: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector, std::allocator>>&&, std::vector, std::allocator>>&&, std::shared_ptr, std::shared_ptr const&, DB::KeyCondition const&, std::optional const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, std::shared_ptr, unsigned long, std::vector>&, bool) @ 0x000000001cd10135 10. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1671: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector, std::allocator>>, std::vector, std::allocator>>, std::shared_ptr const&, DB::SelectQueryInfo const&, std::shared_ptr, unsigned long, std::shared_ptr, std::equal_to, std::allocator>>>, DB::MergeTreeData const&, std::vector> const&, std::shared_ptr, std::optional&) @ 0x000000001dd5ebc4 11. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1570: DB::ReadFromMergeTree::selectRangesToRead(std::vector, std::allocator>>, std::vector, std::allocator>>, std::shared_ptr const&, DB::SelectQueryInfo const&, std::shared_ptr, unsigned long, std::shared_ptr, std::equal_to, std::allocator>>>, DB::MergeTreeData const&, std::vector> const&, std::shared_ptr, std::optional&) @ 0x000000001dd5b86f 12. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1371: DB::ReadFromMergeTree::selectRangesToRead(std::vector, std::allocator>>, std::vector, std::allocator>>) const @ 0x000000001dd5b69e 13. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1854: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000001dd6148c 14. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1969: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd624fb 15. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector>, std::allocator>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd08c90 16. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3371f 17. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b508741 18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50849b 19. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 20. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 21. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 22. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 23. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 24. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 25. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 26. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 27. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 28. ? @ 0x00007f713a222ac3 29. ? @ 0x00007f713a2b4850 2024.12.16 10:52:40.551420 [ 3732 ] {d25c7880-9cc5-4ce8-93dd-26bdd38b6309} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:748: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector, std::allocator>>&&, std::vector, std::allocator>>&&, std::shared_ptr, std::shared_ptr const&, DB::KeyCondition const&, std::optional const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, std::shared_ptr, unsigned long, std::vector>&, bool) @ 0x000000001cd10135 10. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1671: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector, std::allocator>>, std::vector, std::allocator>>, std::shared_ptr const&, DB::SelectQueryInfo const&, std::shared_ptr, unsigned long, std::shared_ptr, std::equal_to, std::allocator>>>, DB::MergeTreeData const&, std::vector> const&, std::shared_ptr, std::optional&) @ 0x000000001dd5ebc4 11. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1570: DB::ReadFromMergeTree::selectRangesToRead(std::vector, std::allocator>>, std::vector, std::allocator>>, std::shared_ptr const&, DB::SelectQueryInfo const&, std::shared_ptr, unsigned long, std::shared_ptr, std::equal_to, std::allocator>>>, DB::MergeTreeData const&, std::vector> const&, std::shared_ptr, std::optional&) @ 0x000000001dd5b86f 12. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1371: DB::ReadFromMergeTree::selectRangesToRead(std::vector, std::allocator>>, std::vector, std::allocator>>) const @ 0x000000001dd5b69e 13. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1854: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000001dd6148c 14. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1969: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd624fb 15. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector>, std::allocator>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd08c90 16. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3371f 17. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b508741 18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50849b 19. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 20. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 21. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 22. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 23. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 24. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 25. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 26. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 27. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 28. ? @ 0x00007f713a222ac3 29. ? @ 0x00007f713a2b4850 2024.12.16 10:52:40.752885 [ 3868 ] {52ad1ba8-16b1-4dc6-9297-c37d8cc4e8b1} executeQuery: Code: 252. DB::Exception: Too many parts (3 with average size of 316.00 B) in table 'test_bfdt4ca7.test (bac16db1-65a2-4ad6-b198-fe1f605b33ce)'. Merges are processing significantly slower than inserts. (TOO_MANY_PARTS) (version 24.3.12.76.altinitystable) (from [::1]:46092) (comment: 02458_relax_too_many_parts.sql) (in query: INSERT INTO test VALUES ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, unsigned long&, ReadableSize&&, String&&) @ 0x000000001cc51a28 6. /build/src/Storages/MergeTree/MergeTreeData.cpp:4450: DB::MergeTreeData::delayInsertOrThrowIfNeeded(Poco::Event*, std::shared_ptr const&, bool) const @ 0x000000001cc033a4 7. /build/src/Storages/MergeTree/MergeTreeSink.cpp:50: DB::MergeTreeSink::onStart() @ 0x000000001d13a96c 8. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:136: DB::ExceptionKeepingTransform::work()::$_0::operator()() const @ 0x000000001da419b9 9. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41995 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41975 11. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41955 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4191d 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 15. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:114: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x000000001da4145a 16. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:136: DB::ExceptionKeepingTransform::work() @ 0x000000001da40d35 17. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 18. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 19. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 20. /build/src/Processors/Executors/PipelineExecutor.cpp:148: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x000000001d51599e 21. /build/src/Processors/Executors/PushingPipelineExecutor.cpp:93: DB::PushingPipelineExecutor::start() @ 0x000000001d5417fc 22. /build/src/Server/TCPHandler.cpp:906: auto DB::TCPHandler::processInsertQuery()::$_0::operator()(DB::PushingPipelineExecutor&, DB::Block) const @ 0x000000001d47d9d5 23. /build/src/Server/TCPHandler.cpp:987: DB::TCPHandler::processInsertQuery() @ 0x000000001d47aa2a 24. /build/src/Server/TCPHandler.cpp:534: DB::TCPHandler::runImpl() @ 0x000000001d46ff31 25. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 26. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 27. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 28. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 29. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 30. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 31. ? @ 0x00007f713a222ac3 2024.12.16 10:52:40.787693 [ 3868 ] {52ad1ba8-16b1-4dc6-9297-c37d8cc4e8b1} TCPHandler: Code: 252. DB::Exception: Too many parts (3 with average size of 316.00 B) in table 'test_bfdt4ca7.test (bac16db1-65a2-4ad6-b198-fe1f605b33ce)'. Merges are processing significantly slower than inserts. (TOO_MANY_PARTS), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, unsigned long&, ReadableSize&&, String&&) @ 0x000000001cc51a28 6. /build/src/Storages/MergeTree/MergeTreeData.cpp:4450: DB::MergeTreeData::delayInsertOrThrowIfNeeded(Poco::Event*, std::shared_ptr const&, bool) const @ 0x000000001cc033a4 7. /build/src/Storages/MergeTree/MergeTreeSink.cpp:50: DB::MergeTreeSink::onStart() @ 0x000000001d13a96c 8. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:136: DB::ExceptionKeepingTransform::work()::$_0::operator()() const @ 0x000000001da419b9 9. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41995 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41975 11. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41955 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4191d 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 15. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:114: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x000000001da4145a 16. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:136: DB::ExceptionKeepingTransform::work() @ 0x000000001da40d35 17. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 18. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 19. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 20. /build/src/Processors/Executors/PipelineExecutor.cpp:148: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x000000001d51599e 21. /build/src/Processors/Executors/PushingPipelineExecutor.cpp:93: DB::PushingPipelineExecutor::start() @ 0x000000001d5417fc 22. /build/src/Server/TCPHandler.cpp:906: auto DB::TCPHandler::processInsertQuery()::$_0::operator()(DB::PushingPipelineExecutor&, DB::Block) const @ 0x000000001d47d9d5 23. /build/src/Server/TCPHandler.cpp:987: DB::TCPHandler::processInsertQuery() @ 0x000000001d47aa2a 24. /build/src/Server/TCPHandler.cpp:534: DB::TCPHandler::runImpl() @ 0x000000001d46ff31 25. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 26. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 27. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 28. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 29. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 30. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 31. ? @ 0x00007f713a222ac3 2024.12.16 10:52:41.998127 [ 4182 ] {5cba9693-88e5-417e-b513-1124e894e0a4} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=10). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:44762) (comment: 01651_group_uniq_array_enum.sql) (in query: SELECT arraySort(groupArray(x)) FROM (SELECT CAST(arrayJoin([1, 2, 3, 2, 3, 3]) AS Enum('Hello' = 1, 'World' = 2, 'Упячка' = 3)) AS x);), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:52:42.047248 [ 4182 ] {5cba9693-88e5-417e-b513-1124e894e0a4} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=10). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:52:42.742739 [ 3855 ] {064fb98d-f2d5-4d08-a4fd-bb8ce6a2af86} executeQuery: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 6.23 MiB (attempt to allocate chunk of 1057847 bytes), maximum: 9.31 GiB. (MEMORY_LIMIT_EXCEEDED) (version 24.3.12.76.altinitystable) (from [::1]:60340) (comment: 02783_date_predicate_optimizations.sql) (in query: INSERT INTO source values ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000132eaf7a 6. /build/src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000132e91eb 7. /build/src/Common/MemoryTracker.cpp:398: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000132e9a62 8. /build/src/Common/CurrentMemoryTracker.cpp:58: CurrentMemoryTracker::allocImpl(long, bool) @ 0x00000000132566f1 9. /build/src/Common/CurrentMemoryTracker.cpp:90: CurrentMemoryTracker::alloc(long) @ 0x0000000013256901 10. /build/src/Common/Allocator.cpp:114: Allocator::alloc(unsigned long, unsigned long) @ 0x00000000132548e6 11. /build/src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001335faec 12. /build/src/IO/BufferWithOwnMemory.h:50: DB::Memory>::Memory(unsigned long, unsigned long) @ 0x000000001335f920 13. /build/src/IO/WriteBufferFromS3.cpp:352: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000001991181a 14. /build/src/IO/WriteBufferFromS3.cpp:342: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000019907b97 15. /build/src/IO/WriteBufferFromS3.cpp:117: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::shared_ptr, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x00000000199074f1 16. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000], String const&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::shared_ptr, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr&&, String const&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::shared_ptr&&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000001a39898f 17. /build/src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:259: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000001a391ede 18. /build/src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:86: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000001a35a491 19. /build/src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:767: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000001a33df8d 20. /build/src/Disks/ObjectStorages/DiskObjectStorage.cpp:560: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000001a31f291 21. /build/src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000001a2f8883 22. /build/src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:141: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000001ca7f5d9 23. /build/src/Storages/MergeTree/IDataPartStorage.h:290: DB::IDataPartStorage::writeFile(String const&, unsigned long, DB::WriteSettings const&) @ 0x000000001ca7c733 24. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:300: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf3a943 25. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 26. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 27. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 28. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 29. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 30. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 2024.12.16 10:52:42.760934 [ 3855 ] {064fb98d-f2d5-4d08-a4fd-bb8ce6a2af86} TCPHandler: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 6.23 MiB (attempt to allocate chunk of 1057847 bytes), maximum: 9.31 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000132eaf7a 6. /build/src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000132e91eb 7. /build/src/Common/MemoryTracker.cpp:398: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000132e9a62 8. /build/src/Common/CurrentMemoryTracker.cpp:58: CurrentMemoryTracker::allocImpl(long, bool) @ 0x00000000132566f1 9. /build/src/Common/CurrentMemoryTracker.cpp:90: CurrentMemoryTracker::alloc(long) @ 0x0000000013256901 10. /build/src/Common/Allocator.cpp:114: Allocator::alloc(unsigned long, unsigned long) @ 0x00000000132548e6 11. /build/src/IO/BufferWithOwnMemory.h:130: DB::Memory>::alloc(unsigned long) @ 0x000000001335faec 12. /build/src/IO/BufferWithOwnMemory.h:50: DB::Memory>::Memory(unsigned long, unsigned long) @ 0x000000001335f920 13. /build/src/IO/WriteBufferFromS3.cpp:352: DB::WriteBufferFromS3::allocateFirstBuffer() @ 0x000000001991181a 14. /build/src/IO/WriteBufferFromS3.cpp:342: DB::WriteBufferFromS3::allocateBuffer() @ 0x0000000019907b97 15. /build/src/IO/WriteBufferFromS3.cpp:117: DB::WriteBufferFromS3::WriteBufferFromS3(std::shared_ptr, String const&, String const&, unsigned long, DB::S3Settings::RequestSettings const&, std::shared_ptr, std::optional, std::allocator>>>, std::function (std::function&&, Priority)>, DB::WriteSettings const&) @ 0x00000000199074f1 16. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000], String const&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::shared_ptr, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>, DB::WriteSettings&>(std::shared_ptr&&, String const&, String const&, unsigned long&, DB::S3Settings::RequestSettings const&, std::shared_ptr&&, std::optional, std::allocator>>>&, std::function (std::function&&, Priority)>&&, DB::WriteSettings&) @ 0x000000001a39898f 17. /build/src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:259: DB::S3ObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000001a391ede 18. /build/src/Disks/ObjectStorages/Cached/CachedObjectStorage.cpp:86: DB::CachedObjectStorage::writeObject(DB::StoredObject const&, DB::WriteMode, std::optional, std::allocator>>>, unsigned long, DB::WriteSettings const&) @ 0x000000001a35a491 19. /build/src/Disks/ObjectStorages/DiskObjectStorageTransaction.cpp:767: DB::DiskObjectStorageTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000001a33df8d 20. /build/src/Disks/ObjectStorages/DiskObjectStorage.cpp:560: DB::DiskObjectStorage::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000001a31f291 21. /build/src/Disks/FakeDiskTransaction.h:69: DB::FakeDiskTransaction::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&, bool) @ 0x000000001a2f8883 22. /build/src/Storages/MergeTree/DataPartStorageOnDiskFull.cpp:141: DB::DataPartStorageOnDiskFull::writeFile(String const&, unsigned long, DB::WriteMode, DB::WriteSettings const&) @ 0x000000001ca7f5d9 23. /build/src/Storages/MergeTree/IDataPartStorage.h:290: DB::IDataPartStorage::writeFile(String const&, unsigned long, DB::WriteSettings const&) @ 0x000000001ca7c733 24. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:300: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf3a943 25. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 26. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 27. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 28. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 29. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 30. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 2024.12.16 10:52:44.103271 [ 3868 ] {b9c7959d-3500-49ed-bd9e-21d3d407ab37} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=3, jobs=3). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:46092) (comment: 02458_relax_too_many_parts.sql) (in query: INSERT INTO test SELECT number, randomString(1000) FROM numbers(0, 10000);), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:49: DB::threadFunction(DB::CompletedPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d512d1d 13. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:90: DB::CompletedPipelineExecutor::execute()::$_0::operator()() const @ 0x000000001d512baa 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d512b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::CompletedPipelineExecutor::execute()::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d512b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::CompletedPipelineExecutor::execute()::$_0&, std::tuple<>&) @ 0x000000001d512a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'()::operator()() @ 0x000000001d5129a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d512915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5128f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5128d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5128a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:52:44.110759 [ 3732 ] {5ca7b167-df9e-47f3-9472-63c76b2b9161} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:44778) (comment: 00173_group_by_use_nulls.sql) (in query: SELECT CounterID AS k, quantileBFloat16(0.5)(ResolutionWidth) FROM remote('127.0.0.{1,2}', test, hits) GROUP BY k ORDER BY count() DESC, CounterID ASC LIMIT 10 SETTINGS group_by_use_nulls = 1;), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:52:44.202867 [ 3868 ] {b9c7959d-3500-49ed-bd9e-21d3d407ab37} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=3, jobs=3). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:49: DB::threadFunction(DB::CompletedPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d512d1d 13. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:90: DB::CompletedPipelineExecutor::execute()::$_0::operator()() const @ 0x000000001d512baa 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d512b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::CompletedPipelineExecutor::execute()::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d512b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::CompletedPipelineExecutor::execute()::$_0&, std::tuple<>&) @ 0x000000001d512a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'()::operator()() @ 0x000000001d5129a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d512915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5128f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5128d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5128a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:52:44.254921 [ 3732 ] {5ca7b167-df9e-47f3-9472-63c76b2b9161} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:52:48.771091 [ 3478 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {c55ac4aa-92c9-4d4b-932f-d2ce86c8486d::202412_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=3). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:310: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf3ab86 21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37f43 23. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb722bf 24. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb725d8 25. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb71fb2 26. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13ef38 27. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x000000001cba15ed 28. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x000000001cba210e 29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef, StrongTypedef, std::basic_string_view>)::'lambda'()::operator()() const @ 0x000000001cba9c78 30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba9c55 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001cba9c35 (version 24.3.12.76.altinitystable) 2024.12.16 10:52:48.994182 [ 3568 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::TraceLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:323: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf3ae44 21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 (version 24.3.12.76.altinitystable) 2024.12.16 10:52:51.800352 [ 3855 ] {2660a04e-5bb2-4d7a-b031-8093050f9315} executeQuery: Code: 395. DB::Exception: Value passed to 'throwIf' function is non-zero: while executing 'FUNCTION throwIf(1_UInt8 :: 1) -> throwIf(1_UInt8) UInt8 : 2'. (FUNCTION_THROW_IF_VALUE_IS_NON_ZERO) (version 24.3.12.76.altinitystable) (from [::1]:41696) (comment: 02006_client_test_hint_error_name.sql) (in query: select throwIf(1);), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000a8efdf3 6. /build/src/Functions/throwIf.cpp:140: COW::immutable_ptr DB::(anonymous namespace)::FunctionThrowIf::execute(DB::IColumn const*, std::optional const&, std::optional const&) const @ 0x0000000011e06e86 7. /build/src/Functions/throwIf.cpp:104: DB::(anonymous namespace)::FunctionThrowIf::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x0000000011e05c3d 8. /build/src/Functions/IFunctionAdaptors.h:21: DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000af6a94d 9. /build/src/Functions/IFunction.cpp:279: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000001906275a 10. /build/src/Functions/IFunction.cpp:336: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019063826 11. /build/src/Functions/IFunction.cpp:411: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x00000000190648b5 12. /build/src/Interpreters/ExpressionActions.cpp:616: DB::executeAction(DB::ExpressionActions::Action const&, DB::(anonymous namespace)::ExecutionContext&, bool, bool) @ 0x000000001a6a1eb7 13. /build/src/Interpreters/ExpressionActions.cpp:746: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool, bool) const @ 0x000000001a6a1247 14. /build/src/Processors/Transforms/ExpressionTransform.cpp:23: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x000000001da42448 15. /build/src/Processors/ISimpleTransform.h:33: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x0000000016042362 16. /build/src/Processors/ISimpleTransform.cpp:89: DB::ISimpleTransform::work() @ 0x000000001d4f49d2 17. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 18. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 19. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 20. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 21. /build/src/Processors/Executors/PipelineExecutor.cpp:411: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514ed5 22. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 23. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 24. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 26. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 27. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 28. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 2024.12.16 10:52:51.806967 [ 3855 ] {2660a04e-5bb2-4d7a-b031-8093050f9315} TCPHandler: Code: 395. DB::Exception: Value passed to 'throwIf' function is non-zero: while executing 'FUNCTION throwIf(1_UInt8 :: 1) -> throwIf(1_UInt8) UInt8 : 2'. (FUNCTION_THROW_IF_VALUE_IS_NON_ZERO), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000a8efdf3 6. /build/src/Functions/throwIf.cpp:140: COW::immutable_ptr DB::(anonymous namespace)::FunctionThrowIf::execute(DB::IColumn const*, std::optional const&, std::optional const&) const @ 0x0000000011e06e86 7. /build/src/Functions/throwIf.cpp:104: DB::(anonymous namespace)::FunctionThrowIf::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x0000000011e05c3d 8. /build/src/Functions/IFunctionAdaptors.h:21: DB::FunctionToExecutableFunctionAdaptor::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000af6a94d 9. /build/src/Functions/IFunction.cpp:279: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000001906275a 10. /build/src/Functions/IFunction.cpp:336: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019063826 11. /build/src/Functions/IFunction.cpp:411: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x00000000190648b5 12. /build/src/Interpreters/ExpressionActions.cpp:616: DB::executeAction(DB::ExpressionActions::Action const&, DB::(anonymous namespace)::ExecutionContext&, bool, bool) @ 0x000000001a6a1eb7 13. /build/src/Interpreters/ExpressionActions.cpp:746: DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool, bool) const @ 0x000000001a6a1247 14. /build/src/Processors/Transforms/ExpressionTransform.cpp:23: DB::ExpressionTransform::transform(DB::Chunk&) @ 0x000000001da42448 15. /build/src/Processors/ISimpleTransform.h:33: DB::ISimpleTransform::transform(DB::Chunk&, DB::Chunk&) @ 0x0000000016042362 16. /build/src/Processors/ISimpleTransform.cpp:89: DB::ISimpleTransform::work() @ 0x000000001d4f49d2 17. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 18. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 19. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 20. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 21. /build/src/Processors/Executors/PipelineExecutor.cpp:411: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514ed5 22. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 23. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 24. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 26. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 27. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 28. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 2024.12.16 10:52:53.425989 [ 3868 ] {4d33becf-06fa-4a1a-8dc9-1d6cd8bf91c2} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=8, jobs=8). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:44786) (comment: 00088_global_in_one_shard_and_rows_before_limit.sql) (in query: SELECT EventDate, count() FROM remote('127.0.0.1', test.hits) WHERE UserID GLOBAL IN (SELECT UserID FROM test.hits) GROUP BY EventDate ORDER BY EventDate LIMIT 5 FORMAT JSONCompact;), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 13. /build/src/Storages/buildQueryTreeForShard.cpp:302: DB::(anonymous namespace)::executeSubqueryNode(std::shared_ptr const&, std::shared_ptr&, unsigned long) @ 0x000000001c7372d9 14. /build/src/Storages/buildQueryTreeForShard.cpp:371: DB::buildQueryTreeForShard(std::shared_ptr const&, std::shared_ptr) @ 0x000000001c735d11 15. /build/src/Storages/StorageDistributed.cpp:828: DB::(anonymous namespace)::buildQueryTreeDistributed(DB::SelectQueryInfo&, std::shared_ptr const&, DB::StorageID const&, std::shared_ptr const&) @ 0x000000001c337535 16. /build/src/Storages/StorageDistributed.cpp:853: DB::StorageDistributed::read(DB::QueryPlan&, std::vector> const&, std::shared_ptr const&, DB::SelectQueryInfo&, std::shared_ptr, DB::QueryProcessingStage::Enum, unsigned long, unsigned long) @ 0x000000001c335bf8 17. /build/src/Planner/PlannerJoinTree.cpp:878: DB::(anonymous namespace)::buildQueryPlanForTableExpression(std::shared_ptr, DB::SelectQueryInfo const&, DB::SelectQueryOptions const&, std::shared_ptr&, bool, bool) @ 0x000000001b553018 18. /build/src/Planner/PlannerJoinTree.cpp:1667: DB::buildJoinTreeQueryPlan(std::shared_ptr const&, DB::SelectQueryInfo const&, DB::SelectQueryOptions&, std::unordered_set, std::equal_to, std::allocator> const&, std::shared_ptr&) @ 0x000000001b54e710 19. /build/src/Planner/Planner.cpp:1473: DB::Planner::buildPlanForQueryNode() @ 0x000000001b50f506 20. /build/src/Planner/Planner.cpp:0: DB::Planner::buildQueryPlanIfNeeded() @ 0x000000001b50b655 21. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:234: DB::InterpreterSelectQueryAnalyzer::getQueryPlan() @ 0x000000001b50885d 22. /build/src/Interpreters/executeQuery.cpp:1146: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb2012 23. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 24. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 25. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 26. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 27. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 28. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 29. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 30. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 31. ? @ 0x00007f713a222ac3 2024.12.16 10:52:53.488896 [ 3868 ] {4d33becf-06fa-4a1a-8dc9-1d6cd8bf91c2} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=8, jobs=8). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 13. /build/src/Storages/buildQueryTreeForShard.cpp:302: DB::(anonymous namespace)::executeSubqueryNode(std::shared_ptr const&, std::shared_ptr&, unsigned long) @ 0x000000001c7372d9 14. /build/src/Storages/buildQueryTreeForShard.cpp:371: DB::buildQueryTreeForShard(std::shared_ptr const&, std::shared_ptr) @ 0x000000001c735d11 15. /build/src/Storages/StorageDistributed.cpp:828: DB::(anonymous namespace)::buildQueryTreeDistributed(DB::SelectQueryInfo&, std::shared_ptr const&, DB::StorageID const&, std::shared_ptr const&) @ 0x000000001c337535 16. /build/src/Storages/StorageDistributed.cpp:853: DB::StorageDistributed::read(DB::QueryPlan&, std::vector> const&, std::shared_ptr const&, DB::SelectQueryInfo&, std::shared_ptr, DB::QueryProcessingStage::Enum, unsigned long, unsigned long) @ 0x000000001c335bf8 17. /build/src/Planner/PlannerJoinTree.cpp:878: DB::(anonymous namespace)::buildQueryPlanForTableExpression(std::shared_ptr, DB::SelectQueryInfo const&, DB::SelectQueryOptions const&, std::shared_ptr&, bool, bool) @ 0x000000001b553018 18. /build/src/Planner/PlannerJoinTree.cpp:1667: DB::buildJoinTreeQueryPlan(std::shared_ptr const&, DB::SelectQueryInfo const&, DB::SelectQueryOptions&, std::unordered_set, std::equal_to, std::allocator> const&, std::shared_ptr&) @ 0x000000001b54e710 19. /build/src/Planner/Planner.cpp:1473: DB::Planner::buildPlanForQueryNode() @ 0x000000001b50f506 20. /build/src/Planner/Planner.cpp:0: DB::Planner::buildQueryPlanIfNeeded() @ 0x000000001b50b655 21. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:234: DB::InterpreterSelectQueryAnalyzer::getQueryPlan() @ 0x000000001b50885d 22. /build/src/Interpreters/executeQuery.cpp:1146: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb2012 23. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 24. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 25. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 26. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 27. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 28. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 29. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 30. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 31. ? @ 0x00007f713a222ac3 2024.12.16 10:53:01.489817 [ 3865 ] {c95e237f-742e-4db2-a98c-0cbb64447cef} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=3). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:44790) (comment: 00146_summing_merge_tree_nested_map.sql) (in query: insert into nested_map (k, `SomeMap.ID`, `SomeMap.Num`) values ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:323: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf3ae44 21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 2024.12.16 10:53:01.531403 [ 3865 ] {c95e237f-742e-4db2-a98c-0cbb64447cef} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=3). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:323: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf3ae44 21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 2024.12.16 10:53:12.573237 [ 3868 ] {e89ecddf-d4d4-4f4a-b7e2-a5b56616b85b} executeQuery: Code: 43. DB::Exception: Second argument for function addSeconds must be a number. (ILLEGAL_TYPE_OF_ARGUMENT) (version 24.3.12.76.altinitystable) (from [::1]:47474) (comment: 02470_suspicious_low_cardinality_msan.sql) (in query: SELECT colAlias0, colAlias2, colAlias3 FROM alias_2__fuzz_25;), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000a8efdf3 6. /build/src/Functions/FunctionDateOrDateTimeAddInterval.h:636: DB::FunctionDateOrDateTimeAddInterval::getReturnTypeImpl(std::vector> const&) const @ 0x000000000b927b6b 7. /build/src/Functions/IFunctionAdaptors.h:136: DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector> const&) const @ 0x000000000af69b50 8. /build/src/Functions/IFunction.cpp:522: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x00000000190653e7 9. /build/src/Functions/IFunction.cpp:468: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x0000000019064e36 10. /build/src/Functions/IFunction.cpp:483: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x0000000019065441 11. /build/src/Functions/FunctionBinaryArithmetic.h:1164: DB::FunctionBinaryArithmetic::executeDateTimeIntervalPlusMinus(std::vector> const&, std::shared_ptr const&, unsigned long, std::shared_ptr const&) const @ 0x000000001116301d 12. /build/src/Functions/FunctionBinaryArithmetic.h:2190: DB::FunctionBinaryArithmetic::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x00000000111614f4 13. /build/src/Functions/IFunction.h:443: DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000a8ef299 14. /build/src/Functions/IFunctionAdaptors.h:26: DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000af6a9ad 15. /build/src/Functions/IFunction.cpp:277: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019062706 16. /build/src/Functions/IFunction.cpp:230: DB::IExecutableFunction::defaultImplementationForNulls(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019062b9c 17. /build/src/Functions/IFunction.cpp:272: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000001906266a 18. /build/src/Functions/IFunction.cpp:336: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019063826 19. /build/src/Functions/IFunction.cpp:411: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x00000000190648b5 20. /build/src/Interpreters/ActionsDAG.cpp:662: DB::executeActionForPartialResult(DB::ActionsDAG::Node const*, std::vector>, unsigned long) @ 0x000000001a43c167 21. /build/src/Interpreters/ActionsDAG.cpp:829: DB::ActionsDAG::evaluatePartialResult(std::unordered_map, std::equal_to, std::allocator>>&, std::vector> const&, unsigned long, bool) @ 0x000000001a43bd9e 22. /build/src/Interpreters/ActionsDAG.cpp:739: DB::ActionsDAG::updateHeader(DB::Block) const @ 0x000000001a43b280 23. /build/src/Processors/Transforms/ExpressionTransform.cpp:8: DB::ExpressionTransform::transformHeader(DB::Block, DB::ActionsDAG const&) @ 0x000000001da421d1 24. /build/src/Processors/QueryPlan/ExpressionStep.cpp:31: DB::ExpressionStep::ExpressionStep(DB::DataStream const&, std::shared_ptr const&) @ 0x000000001dce5126 25. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]>(DB::DataStream const&, std::shared_ptr&&) @ 0x000000001a6eecb1 26. /build/src/Planner/PlannerJoinTree.cpp:606: DB::(anonymous namespace)::createComputeAliasColumnsStep(std::unordered_map, std::hash, std::equal_to, std::allocator>>> const&, DB::DataStream const&) @ 0x000000001b5609f9 27. /build/src/Planner/PlannerJoinTree.cpp:891: DB::(anonymous namespace)::buildQueryPlanForTableExpression(std::shared_ptr, DB::SelectQueryInfo const&, DB::SelectQueryOptions const&, std::shared_ptr&, bool, bool) @ 0x000000001b5530cb 28. /build/src/Planner/PlannerJoinTree.cpp:1667: DB::buildJoinTreeQueryPlan(std::shared_ptr const&, DB::SelectQueryInfo const&, DB::SelectQueryOptions&, std::unordered_set, std::equal_to, std::allocator> const&, std::shared_ptr&) @ 0x000000001b54e710 29. /build/src/Planner/Planner.cpp:1473: DB::Planner::buildPlanForQueryNode() @ 0x000000001b50f506 30. /build/src/Planner/Planner.cpp:0: DB::Planner::buildQueryPlanIfNeeded() @ 0x000000001b50b655 31. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:234: DB::InterpreterSelectQueryAnalyzer::getQueryPlan() @ 0x000000001b50885d 2024.12.16 10:53:12.592638 [ 3868 ] {e89ecddf-d4d4-4f4a-b7e2-a5b56616b85b} TCPHandler: Code: 43. DB::Exception: Second argument for function addSeconds must be a number. (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000a8efdf3 6. /build/src/Functions/FunctionDateOrDateTimeAddInterval.h:636: DB::FunctionDateOrDateTimeAddInterval::getReturnTypeImpl(std::vector> const&) const @ 0x000000000b927b6b 7. /build/src/Functions/IFunctionAdaptors.h:136: DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector> const&) const @ 0x000000000af69b50 8. /build/src/Functions/IFunction.cpp:522: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x00000000190653e7 9. /build/src/Functions/IFunction.cpp:468: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x0000000019064e36 10. /build/src/Functions/IFunction.cpp:483: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x0000000019065441 11. /build/src/Functions/FunctionBinaryArithmetic.h:1164: DB::FunctionBinaryArithmetic::executeDateTimeIntervalPlusMinus(std::vector> const&, std::shared_ptr const&, unsigned long, std::shared_ptr const&) const @ 0x000000001116301d 12. /build/src/Functions/FunctionBinaryArithmetic.h:2190: DB::FunctionBinaryArithmetic::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x00000000111614f4 13. /build/src/Functions/IFunction.h:443: DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000a8ef299 14. /build/src/Functions/IFunctionAdaptors.h:26: DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000af6a9ad 15. /build/src/Functions/IFunction.cpp:277: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019062706 16. /build/src/Functions/IFunction.cpp:230: DB::IExecutableFunction::defaultImplementationForNulls(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019062b9c 17. /build/src/Functions/IFunction.cpp:272: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x000000001906266a 18. /build/src/Functions/IFunction.cpp:336: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019063826 19. /build/src/Functions/IFunction.cpp:411: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x00000000190648b5 20. /build/src/Interpreters/ActionsDAG.cpp:662: DB::executeActionForPartialResult(DB::ActionsDAG::Node const*, std::vector>, unsigned long) @ 0x000000001a43c167 21. /build/src/Interpreters/ActionsDAG.cpp:829: DB::ActionsDAG::evaluatePartialResult(std::unordered_map, std::equal_to, std::allocator>>&, std::vector> const&, unsigned long, bool) @ 0x000000001a43bd9e 22. /build/src/Interpreters/ActionsDAG.cpp:739: DB::ActionsDAG::updateHeader(DB::Block) const @ 0x000000001a43b280 23. /build/src/Processors/Transforms/ExpressionTransform.cpp:8: DB::ExpressionTransform::transformHeader(DB::Block, DB::ActionsDAG const&) @ 0x000000001da421d1 24. /build/src/Processors/QueryPlan/ExpressionStep.cpp:31: DB::ExpressionStep::ExpressionStep(DB::DataStream const&, std::shared_ptr const&) @ 0x000000001dce5126 25. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]>(DB::DataStream const&, std::shared_ptr&&) @ 0x000000001a6eecb1 26. /build/src/Planner/PlannerJoinTree.cpp:606: DB::(anonymous namespace)::createComputeAliasColumnsStep(std::unordered_map, std::hash, std::equal_to, std::allocator>>> const&, DB::DataStream const&) @ 0x000000001b5609f9 27. /build/src/Planner/PlannerJoinTree.cpp:891: DB::(anonymous namespace)::buildQueryPlanForTableExpression(std::shared_ptr, DB::SelectQueryInfo const&, DB::SelectQueryOptions const&, std::shared_ptr&, bool, bool) @ 0x000000001b5530cb 28. /build/src/Planner/PlannerJoinTree.cpp:1667: DB::buildJoinTreeQueryPlan(std::shared_ptr const&, DB::SelectQueryInfo const&, DB::SelectQueryOptions&, std::unordered_set, std::equal_to, std::allocator> const&, std::shared_ptr&) @ 0x000000001b54e710 29. /build/src/Planner/Planner.cpp:1473: DB::Planner::buildPlanForQueryNode() @ 0x000000001b50f506 30. /build/src/Planner/Planner.cpp:0: DB::Planner::buildQueryPlanIfNeeded() @ 0x000000001b50b655 31. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:234: DB::InterpreterSelectQueryAnalyzer::getQueryPlan() @ 0x000000001b50885d 2024.12.16 10:53:15.523556 [ 4187 ] {3b6d6c37-1af7-4294-9009-f8e12854d480} executeQuery: Code: 336. DB::Exception: Ordinary database engine is deprecated (see also allow_deprecated_database_ordinary setting). (UNKNOWN_DATABASE_ENGINE) (version 24.3.12.76.altinitystable) (from [::1]:40730) (comment: 01114_database_atomic.sh) (in query: CREATE DATABASE test_ip6kl7xs_1 ENGINE=Ordinary), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f4eb7 6. /build/src/Databases/DatabaseOrdinary.cpp:528: DB::registerDatabaseOrdinary(DB::DatabaseFactory&)::$_0::operator()(DB::DatabaseFactory::Arguments const&) const @ 0x000000001a0e2b0b 7. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a0e2a3d 8. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001a0e29dd 9. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a0e299d 10. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a0e2965 11. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001a09d77e 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001a09a1bd 13. /build/src/Databases/DatabaseFactory.cpp:158: DB::DatabaseFactory::getImpl(DB::ASTCreateQuery const&, String const&, std::shared_ptr) @ 0x000000001a0998fc 14. /build/src/Databases/DatabaseFactory.cpp:111: DB::DatabaseFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr) @ 0x000000001a09943a 15. /build/src/Interpreters/InterpreterCreateQuery.cpp:291: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000001b00ab5f 16. /build/src/Interpreters/InterpreterCreateQuery.cpp:1791: DB::InterpreterCreateQuery::execute() @ 0x000000001b02103f 17. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 18. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 19. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 20. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 21. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 22. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 23. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 24. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 25. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 26. ? @ 0x00007f713a222ac3 27. ? @ 0x00007f713a2b4850 2024.12.16 10:53:15.539194 [ 4187 ] {3b6d6c37-1af7-4294-9009-f8e12854d480} TCPHandler: Code: 336. DB::Exception: Ordinary database engine is deprecated (see also allow_deprecated_database_ordinary setting). (UNKNOWN_DATABASE_ENGINE), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f4eb7 6. /build/src/Databases/DatabaseOrdinary.cpp:528: DB::registerDatabaseOrdinary(DB::DatabaseFactory&)::$_0::operator()(DB::DatabaseFactory::Arguments const&) const @ 0x000000001a0e2b0b 7. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a0e2a3d 8. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001a0e29dd 9. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a0e299d 10. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a0e2965 11. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001a09d77e 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001a09a1bd 13. /build/src/Databases/DatabaseFactory.cpp:158: DB::DatabaseFactory::getImpl(DB::ASTCreateQuery const&, String const&, std::shared_ptr) @ 0x000000001a0998fc 14. /build/src/Databases/DatabaseFactory.cpp:111: DB::DatabaseFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr) @ 0x000000001a09943a 15. /build/src/Interpreters/InterpreterCreateQuery.cpp:291: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000001b00ab5f 16. /build/src/Interpreters/InterpreterCreateQuery.cpp:1791: DB::InterpreterCreateQuery::execute() @ 0x000000001b02103f 17. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 18. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 19. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 20. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 21. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 22. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 23. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 24. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 25. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 26. ? @ 0x00007f713a222ac3 27. ? @ 0x00007f713a2b4850 2024.12.16 10:53:23.288642 [ 3482 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {543b302c-96aa-4ec0-9035-9e47ab548ac9::202412_1_11_2}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:442: DB::MergeTreeDataPartWriterOnDisk::fillPrimaryIndexChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001cce38ba 21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set, std::equal_to, std::allocator>&) @ 0x000000001ccd3738 22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf3803a 23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37f43 24. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb722bf 25. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb725d8 26. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb71fb2 27. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13ef38 28. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x000000001cba15ed 29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x000000001cba210e 30. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef, StrongTypedef, std::basic_string_view>)::'lambda'()::operator()() const @ 0x000000001cba9c78 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba9c55 (version 24.3.12.76.altinitystable) 2024.12.16 10:53:23.922081 [ 3544 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:286: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf3a6fb 21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 (version 24.3.12.76.altinitystable) 2024.12.16 10:53:26.179706 [ 4187 ] {83a4ca47-b415-4c7c-9a4c-16e75c475c98} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=2). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:45324) (comment: 01018_ddl_dictionaries_special.sql) (in query: INSERT INTO test_11.date_table FORMAT Values), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:294: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf3a8b6 21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 2024.12.16 10:53:26.182537 [ 4187 ] {83a4ca47-b415-4c7c-9a4c-16e75c475c98} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:294: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf3a8b6 21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 2024.12.16 10:53:27.319985 [ 3565 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:296: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd2e93 21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set, std::equal_to, std::allocator>&) @ 0x000000001ccd371a 22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf3803a 23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d (version 24.3.12.76.altinitystable) 2024.12.16 10:53:27.352379 [ 3868 ] {ac43c5af-8a71-4a45-a93b-576dba6a59cd} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=2, jobs=2). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:40742) (comment: 02240_protobuflist_format_persons.sh) (in query: SELECT * FROM persons_02240 ORDER BY name;), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:748: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector, std::allocator>>&&, std::vector, std::allocator>>&&, std::shared_ptr, std::shared_ptr const&, DB::KeyCondition const&, std::optional const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, std::shared_ptr, unsigned long, std::vector>&, bool) @ 0x000000001cd10135 10. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1671: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector, std::allocator>>, std::vector, std::allocator>>, std::shared_ptr const&, DB::SelectQueryInfo const&, std::shared_ptr, unsigned long, std::shared_ptr, std::equal_to, std::allocator>>>, DB::MergeTreeData const&, std::vector> const&, std::shared_ptr, std::optional&) @ 0x000000001dd5ebc4 11. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1570: DB::ReadFromMergeTree::selectRangesToRead(std::vector, std::allocator>>, std::vector, std::allocator>>, std::shared_ptr const&, DB::SelectQueryInfo const&, std::shared_ptr, unsigned long, std::shared_ptr, std::equal_to, std::allocator>>>, DB::MergeTreeData const&, std::vector> const&, std::shared_ptr, std::optional&) @ 0x000000001dd5b86f 12. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1371: DB::ReadFromMergeTree::selectRangesToRead(std::vector, std::allocator>>, std::vector, std::allocator>>) const @ 0x000000001dd5b69e 13. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1854: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000001dd6148c 14. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1969: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd624fb 15. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector>, std::allocator>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd08c90 16. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3371f 17. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b508741 18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50849b 19. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 20. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 21. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 22. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 23. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 24. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 25. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 26. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 27. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 28. ? @ 0x00007f713a222ac3 29. ? @ 0x00007f713a2b4850 2024.12.16 10:53:27.373138 [ 3868 ] {ac43c5af-8a71-4a45-a93b-576dba6a59cd} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=2, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:748: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector, std::allocator>>&&, std::vector, std::allocator>>&&, std::shared_ptr, std::shared_ptr const&, DB::KeyCondition const&, std::optional const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, std::shared_ptr, unsigned long, std::vector>&, bool) @ 0x000000001cd10135 10. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1671: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector, std::allocator>>, std::vector, std::allocator>>, std::shared_ptr const&, DB::SelectQueryInfo const&, std::shared_ptr, unsigned long, std::shared_ptr, std::equal_to, std::allocator>>>, DB::MergeTreeData const&, std::vector> const&, std::shared_ptr, std::optional&) @ 0x000000001dd5ebc4 11. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1570: DB::ReadFromMergeTree::selectRangesToRead(std::vector, std::allocator>>, std::vector, std::allocator>>, std::shared_ptr const&, DB::SelectQueryInfo const&, std::shared_ptr, unsigned long, std::shared_ptr, std::equal_to, std::allocator>>>, DB::MergeTreeData const&, std::vector> const&, std::shared_ptr, std::optional&) @ 0x000000001dd5b86f 12. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1371: DB::ReadFromMergeTree::selectRangesToRead(std::vector, std::allocator>>, std::vector, std::allocator>>) const @ 0x000000001dd5b69e 13. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1854: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000001dd6148c 14. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1969: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd624fb 15. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector>, std::allocator>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd08c90 16. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3371f 17. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b508741 18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50849b 19. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 20. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 21. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 22. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 23. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 24. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 25. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 26. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 27. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 28. ? @ 0x00007f713a222ac3 29. ? @ 0x00007f713a2b4850 2024.12.16 10:53:28.027648 [ 3478 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {41d82839-5472-4425-b891-a2dc2a236577::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=5, jobs=0): (while reading column StartTime): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/41d/41d82839-5472-4425-b891-a2dc2a236577/201403_1_1_0/ in table test.visits (41d82839-5472-4425-b891-a2dc2a236577) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 6658): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe(ThreadPoolImpl>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e92e1 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e917b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e9130 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e90f0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e907b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190eadb1 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e8d90 16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future DB::scheduleFromThreadPoolUnsafe(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl>&, String const&, Priority) @ 0x00000000190e861c 17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e7e3f 18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019365312 19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936561e 20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddc44d 21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6d168 22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6cfbd 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6cf7d 24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6cf3d 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6cf08 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd6a7e 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd2efd 28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fd02d6 29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x0000000019fd045c 30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&) @ 0x000000001ce6ab9b 31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce6a910 (version 24.3.12.76.altinitystable) 2024.12.16 10:53:29.398999 [ 3568 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::TraceLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:147: DB::IMergeTreeDataPart::MinMaxIndex::store(std::vector> const&, std::vector, std::allocator>> const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caad019 21. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:118: DB::IMergeTreeDataPart::MinMaxIndex::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caab9fb 22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:244: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39ccf 23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 26. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 (version 24.3.12.76.altinitystable) 2024.12.16 10:53:32.424160 [ 3549 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::TextLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=3). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:260: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf3a0a0 21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 (version 24.3.12.76.altinitystable) 2024.12.16 10:53:34.468285 [ 3591 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::BlobStorageLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:296: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd2e93 21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set, std::equal_to, std::allocator>&) @ 0x000000001ccd371a 22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf3803a 23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d (version 24.3.12.76.altinitystable) 2024.12.16 10:53:37.393354 [ 4402 ] {557a7624-b307-481c-bd26-0ea8837530c2} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=862, jobs=803). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:45470) (comment: 01114_database_atomic.sh) (in query: SELECT uuid FROM system.databases WHERE name='test_ip6kl7xs_1'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133dc4ad 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d4458 8. /build/src/Common/ThreadPool.cpp:338: ThreadPoolImpl::scheduleOrThrow(std::function, Priority, unsigned long, bool) @ 0x00000000133d4d10 9. /build/src/Common/ThreadPool.h:205: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001d538cf3 10. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:112: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long) @ 0x000000001d538a34 11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:138: DB::PullingAsyncPipelineExecutor::pull(DB::Block&, unsigned long) @ 0x000000001d538de9 12. /build/src/Server/TCPHandler.cpp:1023: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d47ad7f 13. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d47005b 14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 20. ? @ 0x00007f713a222ac3 21. ? @ 0x00007f713a2b4850 2024.12.16 10:53:37.411547 [ 4402 ] {557a7624-b307-481c-bd26-0ea8837530c2} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=862, jobs=803). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133dc4ad 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d4458 8. /build/src/Common/ThreadPool.cpp:338: ThreadPoolImpl::scheduleOrThrow(std::function, Priority, unsigned long, bool) @ 0x00000000133d4d10 9. /build/src/Common/ThreadPool.h:205: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001d538cf3 10. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:112: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long) @ 0x000000001d538a34 11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:138: DB::PullingAsyncPipelineExecutor::pull(DB::Block&, unsigned long) @ 0x000000001d538de9 12. /build/src/Server/TCPHandler.cpp:1023: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d47ad7f 13. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d47005b 14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 20. ? @ 0x00007f713a222ac3 21. ? @ 0x00007f713a2b4850 2024.12.16 10:53:39.472832 [ 3549 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::TextLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=3). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:147: DB::IMergeTreeDataPart::MinMaxIndex::store(std::vector> const&, std::vector, std::allocator>> const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caad019 21. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:118: DB::IMergeTreeDataPart::MinMaxIndex::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caab9fb 22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:244: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39ccf 23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 26. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 (version 24.3.12.76.altinitystable) 2024.12.16 10:53:41.980720 [ 3865 ] {8e1c607e-647c-441d-a4b1-a33c182e5599} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=30, jobs=3): While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:51616) (comment: 00167_parallel_parsing_with_names_and_types.sh) (in query: SELECT URLRegions as d, toTimeZone(ClientEventTime, 'Asia/Dubai') as a, MobilePhoneModel as b, ParamPrice as e, ClientIP6 as c FROM test.hits LIMIT 5000 Format CSVWithNamesAndTypes), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1fc91 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1fb3b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1faf0 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1fab0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1fa3b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce216d1 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1f750 16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future> DB::scheduleFromThreadPoolUnsafe, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl>&, String const&, Priority) @ 0x000000001ce1f09c 17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1d6c3 18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl>*, unsigned long) @ 0x000000001ce1d5b3 19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6eeac 20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, void, void>(std::allocator&, DB::MergeTreeMarksLoader*, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6edb5 21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int>(std::allocator, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6ece3 22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], std::shared_ptr&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, void>(std::allocator const&, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6eb95 23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, void>(std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6e49b 24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&, std::function const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bed3 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bbdd 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bb9d 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bb5d 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bb28 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd6a7e 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd2efd 31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fd02d6 2024.12.16 10:53:42.133522 [ 3865 ] {8e1c607e-647c-441d-a4b1-a33c182e5599} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=30, jobs=3): While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1fc91 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1fb3b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1faf0 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1fab0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1fa3b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce216d1 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1f750 16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future> DB::scheduleFromThreadPoolUnsafe, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl>&, String const&, Priority) @ 0x000000001ce1f09c 17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1d6c3 18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl>*, unsigned long) @ 0x000000001ce1d5b3 19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6eeac 20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, void, void>(std::allocator&, DB::MergeTreeMarksLoader*, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6edb5 21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int>(std::allocator, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6ece3 22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], std::shared_ptr&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, void>(std::allocator const&, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6eb95 23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, void>(std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6e49b 24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&, std::function const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bed3 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bbdd 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bb9d 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bb5d 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bb28 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd6a7e 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd2efd 31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fd02d6 2024.12.16 10:53:42.911737 [ 3751 ] {f92cf173-658f-4581-a5ed-d461703feaa9} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=4, jobs=4). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:45472) (comment: 03230_anyHeavy_merge.sql) (in query: SELECT anyHeavy(if(letter != 'b', letter, NULL)) FROM t;), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:53:43.223453 [ 3751 ] {f92cf173-658f-4581-a5ed-d461703feaa9} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=4, jobs=4). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:53:51.695012 [ 3865 ] {ad38856b-87b1-49ee-ba55-b82e5e4af7b4} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=1). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:51644) (comment: 01114_database_atomic.sh) (in query: INSERT INTO test_ip6kl7xs_3.mt SELECT * FROM numbers(110);), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:294: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf3a8b6 21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 2024.12.16 10:53:51.699231 [ 3865 ] {ad38856b-87b1-49ee-ba55-b82e5e4af7b4} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:294: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf3a8b6 21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 2024.12.16 10:53:52.641776 [ 3545 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::PartLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=3). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:298: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd2eaf 21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set, std::equal_to, std::allocator>&) @ 0x000000001ccd371a 22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf3803a 23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d (version 24.3.12.76.altinitystable) 2024.12.16 10:53:57.420787 [ 4402 ] {4552f834-e118-4d9c-8d68-71a29932c545} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=1, jobs=1). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:50540) (comment: 03228_virtual_column_merge_dist.sql) (in query: SELECT a, _database = currentDatabase() FROM t_merge ORDER BY a;), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:53:57.439345 [ 4402 ] {4552f834-e118-4d9c-8d68-71a29932c545} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=1, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:53:58.999933 [ 3855 ] {3628d17f-83ae-4cda-be3a-b409e2e46a45} executeQuery: Code: 241. DB::Exception: Memory limit (for query) exceeded: would use 477.12 MiB (attempt to allocate chunk of 1048592 bytes), maximum: 476.84 MiB.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 24.3.12.76.altinitystable) (from [::1]:41712) (comment: 01782_field_oom.sql) (in query: SELECT sumMap([number], [number]) FROM system.numbers_mt;), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x00000000132eb2fd 6. /build/src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000132e9710 7. /build/src/Common/MemoryTracker.cpp:398: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000132e9a62 8. /build/src/Common/CurrentMemoryTracker.cpp:58: CurrentMemoryTracker::allocImpl(long, bool) @ 0x00000000132566f1 9. /build/src/Common/CurrentMemoryTracker.cpp:90: CurrentMemoryTracker::alloc(long) @ 0x0000000013256901 10. /build/src/Common/AllocatorWithMemoryTracking.h:33: AllocatorWithMemoryTracking::allocate(unsigned long) @ 0x000000000a99df96 11. /build/contrib/llvm-project/libcxx/include/__memory/allocate_at_least.h:35: std::allocation_result>::pointer> std::allocate_at_least[abi:v15000]>(AllocatorWithMemoryTracking&, unsigned long) @ 0x000000000a99defd 12. /build/contrib/llvm-project/libcxx/include/__memory/allocate_at_least.h:42: auto std::__allocate_at_least[abi:v15000]>(AllocatorWithMemoryTracking&, unsigned long) @ 0x000000000a99dddd 13. /build/contrib/llvm-project/libcxx/include/__split_buffer:316: std::__split_buffer&>::__split_buffer(unsigned long, unsigned long, AllocatorWithMemoryTracking&) @ 0x000000000b9ca0cb 14. /build/contrib/llvm-project/libcxx/include/vector:1048: std::vector>::__append(unsigned long) @ 0x0000000013e9747f 15. /build/contrib/llvm-project/libcxx/include/vector:1918: std::vector>::resize(unsigned long) @ 0x0000000013e971a0 16. /build/src/AggregateFunctions/AggregateFunctionSumMap.cpp:229: DB::(anonymous namespace)::AggregateFunctionMapBase, DB::FieldVisitorSum, false, false, true>::add(char*, DB::IColumn const**, unsigned long, DB::Arena*) const @ 0x0000000014c87a3f 17. /build/src/AggregateFunctions/IAggregateFunction.h:536: DB::IAggregateFunctionHelper>::addBatchSinglePlace(unsigned long, unsigned long, char*, DB::IColumn const**, DB::Arena*, long) const @ 0x0000000014c8a5ea 18. /build/src/Interpreters/Aggregator.cpp:0: DB::Aggregator::addBatchSinglePlace(unsigned long, unsigned long, DB::Aggregator::AggregateFunctionInstruction*, char*, DB::Arena*) @ 0x000000001a72f5d6 19. /build/src/Interpreters/Aggregator.cpp:1344: DB::Aggregator::executeWithoutKeyImpl(char*&, unsigned long, unsigned long, DB::Aggregator::AggregateFunctionInstruction*, DB::Arena*, bool) const @ 0x000000001a72fa25 20. /build/src/Interpreters/Aggregator.cpp:1611: DB::Aggregator::executeOnBlock(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000001a7319c8 21. /build/src/Processors/Transforms/AggregatingTransform.cpp:692: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000001dc98333 22. /build/src/Processors/Transforms/AggregatingTransform.cpp:651: DB::AggregatingTransform::work() @ 0x000000001dc95439 23. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 24. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 25. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 26. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 27. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 2024.12.16 10:53:59.338404 [ 4182 ] {197fb0ae-4361-45e9-a506-7bad3f72a80d} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:50586) (comment: 00967_insert_into_distributed_different_types.sql) (in query: INSERT INTO dist_00967 SELECT toUInt64(number) FROM system.numbers LIMIT 1;), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Storages/Distributed/DistributedSink.cpp:509: DB::DistributedSink::writeSync(DB::Block const&) @ 0x000000001ca45b90 10. /build/src/Storages/Distributed/DistributedSink.cpp:148: DB::DistributedSink::consume(DB::Chunk) @ 0x000000001ca450e6 11. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 12. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:114: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x000000001da4145a 20. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work() @ 0x000000001da40e9e 21. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 22. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 23. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 24. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 25. /build/src/Processors/Executors/PipelineExecutor.cpp:411: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514ed5 26. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 27. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:49: DB::threadFunction(DB::CompletedPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d512d1d 28. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:90: DB::CompletedPipelineExecutor::execute()::$_0::operator()() const @ 0x000000001d512baa 29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d512b55 30. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::CompletedPipelineExecutor::execute()::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d512b39 31. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::CompletedPipelineExecutor::execute()::$_0&, std::tuple<>&) @ 0x000000001d512a9d 2024.12.16 10:53:59.529653 [ 4182 ] {197fb0ae-4361-45e9-a506-7bad3f72a80d} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Storages/Distributed/DistributedSink.cpp:509: DB::DistributedSink::writeSync(DB::Block const&) @ 0x000000001ca45b90 10. /build/src/Storages/Distributed/DistributedSink.cpp:148: DB::DistributedSink::consume(DB::Chunk) @ 0x000000001ca450e6 11. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 12. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:114: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x000000001da4145a 20. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work() @ 0x000000001da40e9e 21. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 22. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 23. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 24. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 25. /build/src/Processors/Executors/PipelineExecutor.cpp:411: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514ed5 26. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 27. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:49: DB::threadFunction(DB::CompletedPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d512d1d 28. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:90: DB::CompletedPipelineExecutor::execute()::$_0::operator()() const @ 0x000000001d512baa 29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d512b55 30. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::CompletedPipelineExecutor::execute()::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d512b39 31. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::CompletedPipelineExecutor::execute()::$_0&, std::tuple<>&) @ 0x000000001d512a9d 2024.12.16 10:54:00.626212 [ 3868 ] {e3967097-dc4b-4b25-93bb-f6c580c2a215} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=2). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:51600) (comment: 02494_query_cache_squash_partial_results.sql) (in query: INSERT INTO t values ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:260: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf3a0a0 21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 2024.12.16 10:54:00.634535 [ 3868 ] {e3967097-dc4b-4b25-93bb-f6c580c2a215} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:260: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf3a0a0 21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 2024.12.16 10:54:04.749892 [ 4401 ] {18c39454-0492-4ede-bd0d-b641b3b00a56} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=862, jobs=797). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:60852) (comment: 01114_database_atomic.sh) (in query: SELECT name, uuid, create_table_query FROM system.tables WHERE database='test_ip6kl7xs_2'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133dc4ad 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d4458 8. /build/src/Common/ThreadPool.cpp:338: ThreadPoolImpl::scheduleOrThrow(std::function, Priority, unsigned long, bool) @ 0x00000000133d4d10 9. /build/src/Common/ThreadPool.h:205: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001d538cf3 10. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:112: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long) @ 0x000000001d538a34 11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:138: DB::PullingAsyncPipelineExecutor::pull(DB::Block&, unsigned long) @ 0x000000001d538de9 12. /build/src/Server/TCPHandler.cpp:1023: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d47ad7f 13. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d47005b 14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 20. ? @ 0x00007f713a222ac3 21. ? @ 0x00007f713a2b4850 2024.12.16 10:54:04.856027 [ 4401 ] {18c39454-0492-4ede-bd0d-b641b3b00a56} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=862, jobs=797). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133dc4ad 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d4458 8. /build/src/Common/ThreadPool.cpp:338: ThreadPoolImpl::scheduleOrThrow(std::function, Priority, unsigned long, bool) @ 0x00000000133d4d10 9. /build/src/Common/ThreadPool.h:205: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001d538cf3 10. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:112: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long) @ 0x000000001d538a34 11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:138: DB::PullingAsyncPipelineExecutor::pull(DB::Block&, unsigned long) @ 0x000000001d538de9 12. /build/src/Server/TCPHandler.cpp:1023: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d47ad7f 13. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d47005b 14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 20. ? @ 0x00007f713a222ac3 21. ? @ 0x00007f713a2b4850 2024.12.16 10:54:08.232905 [ 3868 ] {c7ac1649-31f5-4f75-9d53-d09a9dabd966} executeQuery: Code: 60. DB::Exception: Unknown table expression identifier 'test_ip6kl7xs_1.mt' in scope SELECT n + sleepEachRow(1.5) AS col FROM test_ip6kl7xs_1.mt. (UNKNOWN_TABLE) (version 24.3.12.76.altinitystable) (from [::1]:60892) (comment: 01114_database_atomic.sh) (in query: SELECT count(col), sum(col) FROM (SELECT n + sleepEachRow(1.5) AS col FROM test_ip6kl7xs_1.mt) -- 15146), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String const&, String&&) @ 0x000000000b4fe4cc 6. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6970: DB::(anonymous namespace)::QueryAnalyzer::initializeQueryJoinTreeNode(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a9d52 7. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8159: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09cca3 8. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6519: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a2862 9. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:7911: DB::(anonymous namespace)::QueryAnalyzer::resolveQueryJoinTreeNode(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, DB::(anonymous namespace)::QueryExpressionsAliasVisitor&) @ 0x000000001b0aac8f 10. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8164: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09ccd6 11. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001b09af74 12. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr&, std::shared_ptr) @ 0x000000001b09ac33 13. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr) @ 0x000000001b08c3a6 14. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr const&, DB::SelectQueryOptions const&, std::shared_ptr const&, std::shared_ptr const&) @ 0x000000001b507dac 15. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x000000001b5069e6 16. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr const&, DB::SelectQueryOptions const&) @ 0x000000001b509db7 17. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50924c 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b5091fd 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b50919d 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b50915d 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b509125 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b428b1e 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b42409d 24. /build/src/Interpreters/InterpreterFactory.cpp:355: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000001b42372d 25. /build/src/Interpreters/executeQuery.cpp:1133: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb1cb0 26. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 27. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 28. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 29. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 30. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 31. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 2024.12.16 10:54:08.235480 [ 3868 ] {c7ac1649-31f5-4f75-9d53-d09a9dabd966} TCPHandler: Code: 60. DB::Exception: Unknown table expression identifier 'test_ip6kl7xs_1.mt' in scope SELECT n + sleepEachRow(1.5) AS col FROM test_ip6kl7xs_1.mt. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String const&, String&&) @ 0x000000000b4fe4cc 6. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6970: DB::(anonymous namespace)::QueryAnalyzer::initializeQueryJoinTreeNode(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a9d52 7. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8159: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09cca3 8. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6519: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a2862 9. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:7911: DB::(anonymous namespace)::QueryAnalyzer::resolveQueryJoinTreeNode(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, DB::(anonymous namespace)::QueryExpressionsAliasVisitor&) @ 0x000000001b0aac8f 10. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8164: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09ccd6 11. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001b09af74 12. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr&, std::shared_ptr) @ 0x000000001b09ac33 13. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr) @ 0x000000001b08c3a6 14. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr const&, DB::SelectQueryOptions const&, std::shared_ptr const&, std::shared_ptr const&) @ 0x000000001b507dac 15. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x000000001b5069e6 16. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr const&, DB::SelectQueryOptions const&) @ 0x000000001b509db7 17. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50924c 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b5091fd 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b50919d 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b50915d 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b509125 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b428b1e 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b42409d 24. /build/src/Interpreters/InterpreterFactory.cpp:355: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000001b42372d 25. /build/src/Interpreters/executeQuery.cpp:1133: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb1cb0 26. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 27. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 28. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 29. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 30. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 31. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 2024.12.16 10:54:09.664182 [ 4182 ] {13e8597c-d773-487c-b901-69e1325b015b} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=0). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:60848) (comment: 03228_variant_permutation_issue.sql) (in query: insert into test select id, 'baz' as _data, version+1 as _version from test where id=2;), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:43: DB::MergeTreeDataPartWriterOnDisk::Stream::preFinalize() @ 0x000000001cce58f4 21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:644: DB::MergeTreeDataPartWriterWide::fillDataChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set, std::equal_to, std::allocator>&) @ 0x000000001ccf2d83 22. /build/src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set, std::equal_to, std::allocator>&) @ 0x000000001ccf327e 23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf3803a 24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 26. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 2024.12.16 10:54:09.731011 [ 4182 ] {13e8597c-d773-487c-b901-69e1325b015b} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:43: DB::MergeTreeDataPartWriterOnDisk::Stream::preFinalize() @ 0x000000001cce58f4 21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:644: DB::MergeTreeDataPartWriterWide::fillDataChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set, std::equal_to, std::allocator>&) @ 0x000000001ccf2d83 22. /build/src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set, std::equal_to, std::allocator>&) @ 0x000000001ccf327e 23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf3803a 24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 26. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 2024.12.16 10:54:12.383417 [ 3565 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:302: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf3a9cc 21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 (version 24.3.12.76.altinitystable) 2024.12.16 10:54:12.457149 [ 4187 ] {9eb866a9-611b-43bb-a17e-c166060b3f55} executeQuery: Code: 57. DB::Exception: Table test_ip6kl7xs_1.mt_tmp already exists. (TABLE_ALREADY_EXISTS) (version 24.3.12.76.altinitystable) (from [::1]:49648) (comment: 01114_database_atomic.sh) (in query: RENAME TABLE test_ip6kl7xs_1.mt TO test_ip6kl7xs_1.mt_tmp;), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, DB::StorageID const&) @ 0x000000001988a593 6. /build/src/Interpreters/DatabaseCatalog.cpp:726: DB::DatabaseCatalog::assertTableDoesntExist(DB::StorageID const&, std::shared_ptr) const @ 0x000000001a673c84 7. /build/src/Interpreters/InterpreterRenameQuery.cpp:108: DB::InterpreterRenameQuery::executeToTables(DB::ASTRenameQuery const&, std::vector> const&, std::map>, std::less, std::allocator>>>>&) @ 0x000000001b438e42 8. /build/src/Interpreters/InterpreterRenameQuery.cpp:77: DB::InterpreterRenameQuery::execute() @ 0x000000001b438099 9. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 10. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 11. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 12. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 18. ? @ 0x00007f713a222ac3 19. ? @ 0x00007f713a2b4850 2024.12.16 10:54:12.488998 [ 4187 ] {9eb866a9-611b-43bb-a17e-c166060b3f55} TCPHandler: Code: 57. DB::Exception: Table test_ip6kl7xs_1.mt_tmp already exists. (TABLE_ALREADY_EXISTS), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, DB::StorageID const&) @ 0x000000001988a593 6. /build/src/Interpreters/DatabaseCatalog.cpp:726: DB::DatabaseCatalog::assertTableDoesntExist(DB::StorageID const&, std::shared_ptr) const @ 0x000000001a673c84 7. /build/src/Interpreters/InterpreterRenameQuery.cpp:108: DB::InterpreterRenameQuery::executeToTables(DB::ASTRenameQuery const&, std::vector> const&, std::map>, std::less, std::allocator>>>>&) @ 0x000000001b438e42 8. /build/src/Interpreters/InterpreterRenameQuery.cpp:77: DB::InterpreterRenameQuery::execute() @ 0x000000001b438099 9. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 10. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 11. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 12. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 18. ? @ 0x00007f713a222ac3 19. ? @ 0x00007f713a2b4850 2024.12.16 10:54:12.867205 [ 4182 ] {01a8de7d-e189-491a-a7db-63add389bc6a} executeQuery: Code: 107. DB::Exception: File /var/lib/clickhouse/user_files/nonexist.txt doesn't exist. (FILE_DOESNT_EXIST) (version 24.3.12.76.altinitystable) (from [::1]:49660) (in query: select _path, _file from file('nonexist.txt', 'CSV', 'val1 char')), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageFile.cpp:1573: DB::StorageFile::read(DB::QueryPlan&, std::vector> const&, std::shared_ptr const&, DB::SelectQueryInfo&, std::shared_ptr, DB::QueryProcessingStage::Enum, unsigned long, unsigned long) @ 0x000000001c37a96d 7. /build/src/Planner/PlannerJoinTree.cpp:878: DB::(anonymous namespace)::buildQueryPlanForTableExpression(std::shared_ptr, DB::SelectQueryInfo const&, DB::SelectQueryOptions const&, std::shared_ptr&, bool, bool) @ 0x000000001b553018 8. /build/src/Planner/PlannerJoinTree.cpp:1667: DB::buildJoinTreeQueryPlan(std::shared_ptr const&, DB::SelectQueryInfo const&, DB::SelectQueryOptions&, std::unordered_set, std::equal_to, std::allocator> const&, std::shared_ptr&) @ 0x000000001b54e710 9. /build/src/Planner/Planner.cpp:1473: DB::Planner::buildPlanForQueryNode() @ 0x000000001b50f506 10. /build/src/Planner/Planner.cpp:0: DB::Planner::buildQueryPlanIfNeeded() @ 0x000000001b50b655 11. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:234: DB::InterpreterSelectQueryAnalyzer::getQueryPlan() @ 0x000000001b50885d 12. /build/src/Interpreters/executeQuery.cpp:1146: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb2012 13. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 14. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 15. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 2024.12.16 10:54:12.882036 [ 4182 ] {01a8de7d-e189-491a-a7db-63add389bc6a} TCPHandler: Code: 107. DB::Exception: File /var/lib/clickhouse/user_files/nonexist.txt doesn't exist. (FILE_DOESNT_EXIST), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageFile.cpp:1573: DB::StorageFile::read(DB::QueryPlan&, std::vector> const&, std::shared_ptr const&, DB::SelectQueryInfo&, std::shared_ptr, DB::QueryProcessingStage::Enum, unsigned long, unsigned long) @ 0x000000001c37a96d 7. /build/src/Planner/PlannerJoinTree.cpp:878: DB::(anonymous namespace)::buildQueryPlanForTableExpression(std::shared_ptr, DB::SelectQueryInfo const&, DB::SelectQueryOptions const&, std::shared_ptr&, bool, bool) @ 0x000000001b553018 8. /build/src/Planner/PlannerJoinTree.cpp:1667: DB::buildJoinTreeQueryPlan(std::shared_ptr const&, DB::SelectQueryInfo const&, DB::SelectQueryOptions&, std::unordered_set, std::equal_to, std::allocator> const&, std::shared_ptr&) @ 0x000000001b54e710 9. /build/src/Planner/Planner.cpp:1473: DB::Planner::buildPlanForQueryNode() @ 0x000000001b50f506 10. /build/src/Planner/Planner.cpp:0: DB::Planner::buildQueryPlanIfNeeded() @ 0x000000001b50b655 11. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:234: DB::InterpreterSelectQueryAnalyzer::getQueryPlan() @ 0x000000001b50885d 12. /build/src/Interpreters/executeQuery.cpp:1146: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb2012 13. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 14. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 15. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 2024.12.16 10:54:15.631625 [ 4187 ] {b2621fdc-16c1-47bd-ade6-e4bde4f4c274} executeQuery: Code: 60. DB::Exception: Unknown table expression identifier 'test_ip6kl7xs_1.mt' in scope SELECT count() FROM test_ip6kl7xs_1.mt. (UNKNOWN_TABLE) (version 24.3.12.76.altinitystable) (from [::1]:49690) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM test_ip6kl7xs_1.mt), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String const&, String&&) @ 0x000000000b4fe4cc 6. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6970: DB::(anonymous namespace)::QueryAnalyzer::initializeQueryJoinTreeNode(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a9d52 7. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8159: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09cca3 8. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001b09af74 9. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr&, std::shared_ptr) @ 0x000000001b09ac33 10. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr) @ 0x000000001b08c3a6 11. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr const&, DB::SelectQueryOptions const&, std::shared_ptr const&, std::shared_ptr const&) @ 0x000000001b507dac 12. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x000000001b5069e6 13. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr const&, DB::SelectQueryOptions const&) @ 0x000000001b509db7 14. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50924c 15. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b5091fd 16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b50919d 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b50915d 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b509125 19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b428b1e 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b42409d 21. /build/src/Interpreters/InterpreterFactory.cpp:355: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000001b42372d 22. /build/src/Interpreters/executeQuery.cpp:1133: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb1cb0 23. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 24. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 25. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 26. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 27. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 28. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 29. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 30. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 31. ? @ 0x00007f713a222ac3 2024.12.16 10:54:15.639656 [ 4187 ] {b2621fdc-16c1-47bd-ade6-e4bde4f4c274} TCPHandler: Code: 60. DB::Exception: Unknown table expression identifier 'test_ip6kl7xs_1.mt' in scope SELECT count() FROM test_ip6kl7xs_1.mt. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String const&, String&&) @ 0x000000000b4fe4cc 6. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6970: DB::(anonymous namespace)::QueryAnalyzer::initializeQueryJoinTreeNode(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a9d52 7. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8159: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09cca3 8. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001b09af74 9. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr&, std::shared_ptr) @ 0x000000001b09ac33 10. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr) @ 0x000000001b08c3a6 11. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr const&, DB::SelectQueryOptions const&, std::shared_ptr const&, std::shared_ptr const&) @ 0x000000001b507dac 12. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x000000001b5069e6 13. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr const&, DB::SelectQueryOptions const&) @ 0x000000001b509db7 14. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50924c 15. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b5091fd 16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b50919d 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b50915d 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b509125 19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b428b1e 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b42409d 21. /build/src/Interpreters/InterpreterFactory.cpp:355: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000001b42372d 22. /build/src/Interpreters/executeQuery.cpp:1133: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb1cb0 23. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 24. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 25. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 26. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 27. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 28. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 29. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 30. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 31. ? @ 0x00007f713a222ac3 2024.12.16 10:54:18.881030 [ 4187 ] {9582d5ec-8980-49ec-8b46-b3c1e72ca1fb} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=3, jobs=3). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:49694) (comment: 02661_read_from_archive_tzst.sh) (in query: SELECT * FROM file('/var/lib/clickhouse/user_files/02661_read_from_archive_test_lwsljr0k_tzst_archive1.tzst :: 02661_read_from_archive_test_lwsljr0k_tzst_data1.csv') ORDER BY 1, 2), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:54:18.991348 [ 4187 ] {9582d5ec-8980-49ec-8b46-b3c1e72ca1fb} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=3, jobs=3). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:54:21.537608 [ 4182 ] {9295d464-27b5-44d2-a3c2-fd58fb0215b6} executeQuery: Code: 390. DB::Exception: Table `mt` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY) (version 24.3.12.76.altinitystable) (from [::1]:49740) (comment: 01114_database_atomic.sh) (in query: SHOW CREATE TABLE test_ip6kl7xs_1.mt), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000a8efdf3 6. /build/src/Databases/DatabaseOnDisk.cpp:504: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000001a0b6c96 7. /build/src/Databases/IDatabase.h:327: DB::IDatabase::getCreateTableQuery(String const&, std::shared_ptr) const @ 0x0000000019879ff7 8. /build/src/Interpreters/InterpreterShowCreateQuery.cpp:63: DB::InterpreterShowCreateQuery::executeImpl() @ 0x000000001bc1fef6 9. /build/src/Interpreters/InterpreterShowCreateQuery.cpp:31: DB::InterpreterShowCreateQuery::execute() @ 0x000000001bc1f9eb 10. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 11. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 12. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 13. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 14. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 15. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 16. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 17. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 18. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 19. ? @ 0x00007f713a222ac3 20. ? @ 0x00007f713a2b4850 2024.12.16 10:54:21.554601 [ 4182 ] {9295d464-27b5-44d2-a3c2-fd58fb0215b6} TCPHandler: Code: 390. DB::Exception: Table `mt` doesn't exist. (CANNOT_GET_CREATE_TABLE_QUERY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000a8efdf3 6. /build/src/Databases/DatabaseOnDisk.cpp:504: DB::DatabaseOnDisk::getCreateTableQueryImpl(String const&, std::shared_ptr, bool) const @ 0x000000001a0b6c96 7. /build/src/Databases/IDatabase.h:327: DB::IDatabase::getCreateTableQuery(String const&, std::shared_ptr) const @ 0x0000000019879ff7 8. /build/src/Interpreters/InterpreterShowCreateQuery.cpp:63: DB::InterpreterShowCreateQuery::executeImpl() @ 0x000000001bc1fef6 9. /build/src/Interpreters/InterpreterShowCreateQuery.cpp:31: DB::InterpreterShowCreateQuery::execute() @ 0x000000001bc1f9eb 10. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 11. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 12. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 13. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 14. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 15. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 16. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 17. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 18. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 19. ? @ 0x00007f713a222ac3 20. ? @ 0x00007f713a2b4850 2024.12.16 10:54:22.884785 [ 4182 ] {7c8c4139-9821-442b-a41c-e792e2692dbe} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=8, jobs=3). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:49748) (comment: 02122_parallel_formatting_JSONStringsEachRow.sh) (in query: select number, number + 1, concat('string: ', toString(number)) from numbers(200000) group by number with totals order by number limit 190000 format JSONStringsEachRow), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:54:22.908196 [ 4182 ] {7c8c4139-9821-442b-a41c-e792e2692dbe} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=8, jobs=3). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:54:23.497253 [ 3551 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::ProcessorProfileLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=3). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:298: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd2eaf 21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set, std::equal_to, std::allocator>&) @ 0x000000001ccd371a 22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf3803a 23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d (version 24.3.12.76.altinitystable) 2024.12.16 10:54:24.910885 [ 4401 ] {7cc6c321-598f-4ceb-8cad-a18215c1a50e} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:49676) (comment: 03222_datetime64_small_value_const.sql) (in query: create table distr_03222_dt64 (id UInt64, dt DateTime64(3)) engine = Distributed(test_cluster_two_shards_different_databases, '', dt64_03222);), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:169: DB::ThreadPoolCallbackRunnerLocal>, std::function>::operator()(std::function&&, Priority) @ 0x0000000018f68e7a 10. /build/src/Storages/StorageDistributed.cpp:1296: DB::StorageDistributed::initializeFromDisk() @ 0x000000001c330c5a 11. /build/src/Storages/StorageDistributed.cpp:385: DB::StorageDistributed::StorageDistributed(DB::StorageID const&, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, String const&, String const&, String const&, String const&, std::shared_ptr, std::shared_ptr const&, String const&, String const&, DB::DistributedSettings const&, DB::LoadingStrictnessLevel, std::shared_ptr, std::shared_ptr) @ 0x000000001c3304e8 12. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageDistributed* std::construct_at[abi:v15000] const&, std::shared_ptr const&, String&, String const&, DB::DistributedSettings&, DB::LoadingStrictnessLevel const&, DB::StorageDistributed*>(DB::StorageDistributed*, DB::StorageID const&, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, String const&, String&, String&, String&, std::shared_ptr const&, std::shared_ptr const&, String&, String const&, DB::DistributedSettings&, DB::LoadingStrictnessLevel const&) @ 0x000000001c362fb9 13. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000] const&, std::shared_ptr const&, String&, String const&, DB::DistributedSettings&, DB::LoadingStrictnessLevel const&, void, void>(std::allocator&, DB::StorageDistributed*, DB::StorageID const&, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, String const&, String&, String&, String&, std::shared_ptr const&, std::shared_ptr const&, String&, String const&, DB::DistributedSettings&, DB::LoadingStrictnessLevel const&) @ 0x000000001c362dd1 14. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000] const&, std::shared_ptr const&, String&, String const&, DB::DistributedSettings&, DB::LoadingStrictnessLevel const&>(std::allocator, DB::StorageID const&, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, String const&, String&, String&, String&, std::shared_ptr const&, std::shared_ptr const&, String&, String const&, DB::DistributedSettings&, DB::LoadingStrictnessLevel const&) @ 0x000000001c362cb2 15. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, String const&, String&, String&, String&, std::shared_ptr const&, std::shared_ptr const&, String&, String const&, DB::DistributedSettings&, DB::LoadingStrictnessLevel const&, void>(std::allocator const&, DB::StorageID const&, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, String const&, String&, String&, String&, std::shared_ptr const&, std::shared_ptr const&, String&, String const&, DB::DistributedSettings&, DB::LoadingStrictnessLevel const&) @ 0x000000001c362b00 16. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000] const&, std::shared_ptr const&, String&, String const&, DB::DistributedSettings&, DB::LoadingStrictnessLevel const&, void>(DB::StorageID const&, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, String const&, String&, String&, String&, std::shared_ptr const&, std::shared_ptr const&, String&, String const&, DB::DistributedSettings&, DB::LoadingStrictnessLevel const&) @ 0x000000001c3629fc 17. /build/src/Storages/StorageDistributed.cpp:1968: DB::registerStorageDistributed(DB::StorageFactory&)::$_0::operator()(DB::StorageFactory::Arguments const&) const @ 0x000000001c34c3f4 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c34b51d 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001c34b4bd 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c34b47d 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c34b445 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001c3709de 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001c36f2fd 24. /build/src/Storages/StorageFactory.cpp:224: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, DB::LoadingStrictnessLevel) const @ 0x000000001c36dc1d 25. /build/src/Interpreters/InterpreterCreateQuery.cpp:1493: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x000000001b01e40c 26. /build/src/Interpreters/InterpreterCreateQuery.cpp:1313: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x000000001b018366 27. /build/src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x000000001b021096 28. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 29. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 30. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 31. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 2024.12.16 10:54:24.952971 [ 4401 ] {7cc6c321-598f-4ceb-8cad-a18215c1a50e} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:169: DB::ThreadPoolCallbackRunnerLocal>, std::function>::operator()(std::function&&, Priority) @ 0x0000000018f68e7a 10. /build/src/Storages/StorageDistributed.cpp:1296: DB::StorageDistributed::initializeFromDisk() @ 0x000000001c330c5a 11. /build/src/Storages/StorageDistributed.cpp:385: DB::StorageDistributed::StorageDistributed(DB::StorageID const&, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, String const&, String const&, String const&, String const&, std::shared_ptr, std::shared_ptr const&, String const&, String const&, DB::DistributedSettings const&, DB::LoadingStrictnessLevel, std::shared_ptr, std::shared_ptr) @ 0x000000001c3304e8 12. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageDistributed* std::construct_at[abi:v15000] const&, std::shared_ptr const&, String&, String const&, DB::DistributedSettings&, DB::LoadingStrictnessLevel const&, DB::StorageDistributed*>(DB::StorageDistributed*, DB::StorageID const&, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, String const&, String&, String&, String&, std::shared_ptr const&, std::shared_ptr const&, String&, String const&, DB::DistributedSettings&, DB::LoadingStrictnessLevel const&) @ 0x000000001c362fb9 13. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000] const&, std::shared_ptr const&, String&, String const&, DB::DistributedSettings&, DB::LoadingStrictnessLevel const&, void, void>(std::allocator&, DB::StorageDistributed*, DB::StorageID const&, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, String const&, String&, String&, String&, std::shared_ptr const&, std::shared_ptr const&, String&, String const&, DB::DistributedSettings&, DB::LoadingStrictnessLevel const&) @ 0x000000001c362dd1 14. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000] const&, std::shared_ptr const&, String&, String const&, DB::DistributedSettings&, DB::LoadingStrictnessLevel const&>(std::allocator, DB::StorageID const&, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, String const&, String&, String&, String&, std::shared_ptr const&, std::shared_ptr const&, String&, String const&, DB::DistributedSettings&, DB::LoadingStrictnessLevel const&) @ 0x000000001c362cb2 15. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, String const&, String&, String&, String&, std::shared_ptr const&, std::shared_ptr const&, String&, String const&, DB::DistributedSettings&, DB::LoadingStrictnessLevel const&, void>(std::allocator const&, DB::StorageID const&, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, String const&, String&, String&, String&, std::shared_ptr const&, std::shared_ptr const&, String&, String const&, DB::DistributedSettings&, DB::LoadingStrictnessLevel const&) @ 0x000000001c362b00 16. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000] const&, std::shared_ptr const&, String&, String const&, DB::DistributedSettings&, DB::LoadingStrictnessLevel const&, void>(DB::StorageID const&, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, String const&, String&, String&, String&, std::shared_ptr const&, std::shared_ptr const&, String&, String const&, DB::DistributedSettings&, DB::LoadingStrictnessLevel const&) @ 0x000000001c3629fc 17. /build/src/Storages/StorageDistributed.cpp:1968: DB::registerStorageDistributed(DB::StorageFactory&)::$_0::operator()(DB::StorageFactory::Arguments const&) const @ 0x000000001c34c3f4 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c34b51d 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001c34b4bd 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c34b47d 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c34b445 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001c3709de 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001c36f2fd 24. /build/src/Storages/StorageFactory.cpp:224: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, DB::LoadingStrictnessLevel) const @ 0x000000001c36dc1d 25. /build/src/Interpreters/InterpreterCreateQuery.cpp:1493: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x000000001b01e40c 26. /build/src/Interpreters/InterpreterCreateQuery.cpp:1313: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x000000001b018366 27. /build/src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x000000001b021096 28. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 29. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 30. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 31. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 2024.12.16 10:54:27.158653 [ 3865 ] {51c9319d-1fcd-4290-b4a8-1c6a8a084ccc} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:49804) (comment: 02122_parallel_formatting_JSONStringsEachRow.sh) (in query: select number, number + 1, concat('string: ', toString(number)) from numbers(200000) group by number with totals order by number limit 190000 format JSONStringsEachRow), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:54:27.437367 [ 3865 ] {51c9319d-1fcd-4290-b4a8-1c6a8a084ccc} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:54:27.438238 [ 5021 ] {03a88259-36d5-4eb0-ba35-1fdfc342ab8c} executeQuery: Code: 60. DB::Exception: Table test_ip6kl7xs_1.mt does not exist. Maybe you meant test_ip6kl7xs_2.mt?. (UNKNOWN_TABLE) (version 24.3.12.76.altinitystable) (from [::1]:49810) (comment: 01114_database_atomic.sh) (in query: DROP TABLE test_ip6kl7xs_1.mt SETTINGS database_atomic_wait_for_drop_and_detach_synchronously=0;), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&, String&&) @ 0x000000000aa26ae4 6. /build/src/Databases/IDatabase.cpp:39: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000001a145dcb 7. /build/src/Interpreters/DatabaseCatalog.cpp:429: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000001a66ff96 8. /build/src/Interpreters/DatabaseCatalog.cpp:966: DB::DatabaseCatalog::getDatabaseAndTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000001a6754d8 9. /build/src/Interpreters/InterpreterDropQuery.cpp:131: DB::InterpreterDropQuery::executeToTableImpl(std::shared_ptr, DB::ASTDropQuery&, std::shared_ptr&, StrongTypedef, DB::UUIDTag>&) @ 0x000000001b03bf01 10. /build/src/Interpreters/InterpreterDropQuery.cpp:102: DB::InterpreterDropQuery::executeToTable(DB::ASTDropQuery&) @ 0x000000001b03b594 11. /build/src/Interpreters/InterpreterDropQuery.cpp:73: DB::InterpreterDropQuery::execute() @ 0x000000001b03ab4e 12. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 13. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 14. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 15. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 2024.12.16 10:54:27.456797 [ 5021 ] {03a88259-36d5-4eb0-ba35-1fdfc342ab8c} TCPHandler: Code: 60. DB::Exception: Table test_ip6kl7xs_1.mt does not exist. Maybe you meant test_ip6kl7xs_2.mt?. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&, String&&) @ 0x000000000aa26ae4 6. /build/src/Databases/IDatabase.cpp:39: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000001a145dcb 7. /build/src/Interpreters/DatabaseCatalog.cpp:429: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000001a66ff96 8. /build/src/Interpreters/DatabaseCatalog.cpp:966: DB::DatabaseCatalog::getDatabaseAndTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000001a6754d8 9. /build/src/Interpreters/InterpreterDropQuery.cpp:131: DB::InterpreterDropQuery::executeToTableImpl(std::shared_ptr, DB::ASTDropQuery&, std::shared_ptr&, StrongTypedef, DB::UUIDTag>&) @ 0x000000001b03bf01 10. /build/src/Interpreters/InterpreterDropQuery.cpp:102: DB::InterpreterDropQuery::executeToTable(DB::ASTDropQuery&) @ 0x000000001b03b594 11. /build/src/Interpreters/InterpreterDropQuery.cpp:73: DB::InterpreterDropQuery::execute() @ 0x000000001b03ab4e 12. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 13. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 14. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 15. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 2024.12.16 10:54:30.034616 [ 5021 ] {4b8c1edc-c27e-4762-a981-b937a17eca29} executeQuery: Code: 60. DB::Exception: Unknown table expression identifier 'test_ip6kl7xs_1.mt' in scope SELECT (s, sleepEachRow(3)) FROM test_ip6kl7xs_1.mt. (UNKNOWN_TABLE) (version 24.3.12.76.altinitystable) (from [::1]:51586) (comment: 01114_database_atomic.sh) (in query: SELECT tuple(s, sleepEachRow(3)) FROM test_ip6kl7xs_1.mt -- 11317_tuple), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String const&, String&&) @ 0x000000000b4fe4cc 6. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6970: DB::(anonymous namespace)::QueryAnalyzer::initializeQueryJoinTreeNode(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a9d52 7. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8159: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09cca3 8. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001b09af74 9. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr&, std::shared_ptr) @ 0x000000001b09ac33 10. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr) @ 0x000000001b08c3a6 11. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr const&, DB::SelectQueryOptions const&, std::shared_ptr const&, std::shared_ptr const&) @ 0x000000001b507dac 12. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x000000001b5069e6 13. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr const&, DB::SelectQueryOptions const&) @ 0x000000001b509db7 14. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50924c 15. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b5091fd 16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b50919d 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b50915d 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b509125 19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b428b1e 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b42409d 21. /build/src/Interpreters/InterpreterFactory.cpp:355: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000001b42372d 22. /build/src/Interpreters/executeQuery.cpp:1133: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb1cb0 23. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 24. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 25. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 26. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 27. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 28. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 29. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 30. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 31. ? @ 0x00007f713a222ac3 2024.12.16 10:54:30.040552 [ 5021 ] {4b8c1edc-c27e-4762-a981-b937a17eca29} TCPHandler: Code: 60. DB::Exception: Unknown table expression identifier 'test_ip6kl7xs_1.mt' in scope SELECT (s, sleepEachRow(3)) FROM test_ip6kl7xs_1.mt. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String const&, String&&) @ 0x000000000b4fe4cc 6. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6970: DB::(anonymous namespace)::QueryAnalyzer::initializeQueryJoinTreeNode(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a9d52 7. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8159: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09cca3 8. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001b09af74 9. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr&, std::shared_ptr) @ 0x000000001b09ac33 10. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr) @ 0x000000001b08c3a6 11. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr const&, DB::SelectQueryOptions const&, std::shared_ptr const&, std::shared_ptr const&) @ 0x000000001b507dac 12. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x000000001b5069e6 13. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr const&, DB::SelectQueryOptions const&) @ 0x000000001b509db7 14. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50924c 15. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b5091fd 16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b50919d 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b50915d 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b509125 19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b428b1e 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b42409d 21. /build/src/Interpreters/InterpreterFactory.cpp:355: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000001b42372d 22. /build/src/Interpreters/executeQuery.cpp:1133: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb1cb0 23. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 24. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 25. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 26. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 27. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 28. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 29. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 30. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 31. ? @ 0x00007f713a222ac3 2024.12.16 10:54:30.275137 [ 3868 ] {399d5638-aae5-40cb-ba30-e43e9c1b8156} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=862, jobs=798). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:51576) (comment: 03221_mutation_analyzer_skip_part.sql) (in query: INSERT INTO t_mutate_skip_part SELECT 1, number, number, number FROM numbers(10000);), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133dc4ad 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d4458 8. /build/src/Common/ThreadPool.cpp:338: ThreadPoolImpl::scheduleOrThrow(std::function, Priority, unsigned long, bool) @ 0x00000000133d4d10 9. /build/src/Common/ThreadPool.h:205: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&) @ 0x000000001d512401 10. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:92: DB::CompletedPipelineExecutor::execute() @ 0x000000001d512016 11. /build/src/Server/TCPHandler.cpp:566: DB::TCPHandler::runImpl() @ 0x000000001d4701b1 12. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 18. ? @ 0x00007f713a222ac3 19. ? @ 0x00007f713a2b4850 2024.12.16 10:54:30.334944 [ 3868 ] {399d5638-aae5-40cb-ba30-e43e9c1b8156} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=862, jobs=798). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133dc4ad 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d4458 8. /build/src/Common/ThreadPool.cpp:338: ThreadPoolImpl::scheduleOrThrow(std::function, Priority, unsigned long, bool) @ 0x00000000133d4d10 9. /build/src/Common/ThreadPool.h:205: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&) @ 0x000000001d512401 10. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:92: DB::CompletedPipelineExecutor::execute() @ 0x000000001d512016 11. /build/src/Server/TCPHandler.cpp:566: DB::TCPHandler::runImpl() @ 0x000000001d4701b1 12. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 18. ? @ 0x00007f713a222ac3 19. ? @ 0x00007f713a2b4850 2024.12.16 10:54:30.677649 [ 3865 ] {1b7ccd18-bd12-4836-be6f-881dc055de63} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=2, jobs=2). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:51578) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM system.processes WHERE query_id != queryID() AND current_database = currentDatabase() AND query LIKE '%-- 11317_tuple%'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:54:30.742903 [ 3865 ] {1b7ccd18-bd12-4836-be6f-881dc055de63} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=2, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:54:31.908591 [ 3868 ] {7c848e81-a5eb-4d97-bb41-ac5b43addab0} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=19, jobs=19). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:51598) (comment: 02661_read_from_archive_tzst.sh) (in query: SELECT * FROM 02661_archive_table ORDER BY 1, 2), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:54:32.059465 [ 3868 ] {7c848e81-a5eb-4d97-bb41-ac5b43addab0} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=19, jobs=19). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:54:36.866124 [ 3591 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::BlobStorageLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:274: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf3a3c4 21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 (version 24.3.12.76.altinitystable) 2024.12.16 10:54:38.178389 [ 3568 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::TraceLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergeTreePartition.cpp:441: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000001ce2fec6 21. /build/src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001ce2f078 22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:239: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39bb5 23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 26. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 (version 24.3.12.76.altinitystable) 2024.12.16 10:54:38.790903 [ 3549 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::TextLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:442: DB::MergeTreeDataPartWriterOnDisk::fillPrimaryIndexChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001cce38ba 21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set, std::equal_to, std::allocator>&) @ 0x000000001ccd3738 22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf3803a 23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d (version 24.3.12.76.altinitystable) 2024.12.16 10:54:40.212424 [ 3552 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:260: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf3a0a0 21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 (version 24.3.12.76.altinitystable) 2024.12.16 10:54:43.201525 [ 3232 ] {} test_by8lk4e9.test_03217_merge_replica_1 (c3e593ea-4c1a-48c9-ac00-7e1c75eca03b): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/test_by8lk4e9/test_03217_merge_replica/replicas/r1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:54:44.030986 [ 5023 ] {6b3d682e-2206-4b24-a260-2751d2514dc1} executeQuery: Code: 43. DB::Exception: Nested type Tuple(UInt64, UInt64) cannot be inside Nullable type. (ILLEGAL_TYPE_OF_ARGUMENT) (version 24.3.12.76.altinitystable) (from [::1]:50858) (comment: 02922_respect_nulls_Nullable.sql) (in query: -- { echoOn } Select anyOrNull(tp) FROM (Select (number, number) as tp from numbers(10));), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000a8efdf3 6. /build/src/DataTypes/DataTypeNullable.cpp:29: DB::DataTypeNullable::DataTypeNullable(std::shared_ptr const&) @ 0x0000000019f1c60c 7. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::DataTypeNullable* std::construct_at[abi:v15000] const&, DB::DataTypeNullable*>(DB::DataTypeNullable*, std::shared_ptr const&) @ 0x000000001602a8e6 8. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000] const&, void, void>(std::allocator&, DB::DataTypeNullable*, std::shared_ptr const&) @ 0x000000001602a861 9. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000] const&>(std::allocator, std::shared_ptr const&) @ 0x000000001602a7e7 10. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], std::shared_ptr const&, void>(std::allocator const&, std::shared_ptr const&) @ 0x000000001602a717 11. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000] const&, void>(std::shared_ptr const&) @ 0x000000001602a6c6 12. /build/src/AggregateFunctions/Combinators/AggregateFunctionOrFill.h:256: DB::AggregateFunctionOrFill::createResultType(std::shared_ptr const&) @ 0x00000000160290ce 13. /build/src/AggregateFunctions/Combinators/AggregateFunctionOrFill.h:37: DB::AggregateFunctionOrFill::AggregateFunctionOrFill(std::shared_ptr, std::vector, std::allocator>> const&, DB::Array const&) @ 0x0000000016028efd 14. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::AggregateFunctionOrFill* std::construct_at[abi:v15000], std::shared_ptr const&, std::vector, std::allocator>> const&, DB::Array const&, DB::AggregateFunctionOrFill*>(DB::AggregateFunctionOrFill*, std::shared_ptr const&, std::vector, std::allocator>> const&, DB::Array const&) @ 0x0000000016028e89 15. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>>::construct[abi:v15000], std::shared_ptr const&, std::vector, std::allocator>> const&, DB::Array const&, void, void>(std::allocator>&, DB::AggregateFunctionOrFill*, std::shared_ptr const&, std::vector, std::allocator>> const&, DB::Array const&) @ 0x0000000016028c31 16. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace, std::allocator>>::__shared_ptr_emplace[abi:v15000] const&, std::vector, std::allocator>> const&, DB::Array const&>(std::allocator>, std::shared_ptr const&, std::vector, std::allocator>> const&, DB::Array const&) @ 0x0000000016028917 17. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr> std::allocate_shared[abi:v15000], std::allocator>, std::shared_ptr const&, std::vector, std::allocator>> const&, DB::Array const&, void>(std::allocator> const&, std::shared_ptr const&, std::vector, std::allocator>> const&, DB::Array const&) @ 0x000000001602878a 18. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr> std::make_shared[abi:v15000], std::shared_ptr const&, std::vector, std::allocator>> const&, DB::Array const&, void>(std::shared_ptr const&, std::vector, std::allocator>> const&, DB::Array const&) @ 0x00000000160285b6 19. /build/src/AggregateFunctions/Combinators/AggregateFunctionOrFill.cpp:39: DB::(anonymous namespace)::AggregateFunctionCombinatorOrFill::transformAggregateFunction(std::shared_ptr const&, DB::AggregateFunctionProperties const&, std::vector, std::allocator>> const&, DB::Array const&) const @ 0x000000001602825b 20. /build/src/AggregateFunctions/AggregateFunctionFactory.cpp:249: DB::AggregateFunctionFactory::getImpl(String const&, DB::NullsAction, std::vector, std::allocator>> const&, DB::Array const&, DB::AggregateFunctionProperties&, bool) const @ 0x00000000190bb032 21. /build/src/AggregateFunctions/AggregateFunctionFactory.cpp:123: DB::AggregateFunctionFactory::get(String const&, DB::NullsAction, std::vector, std::allocator>> const&, DB::Array const&, DB::AggregateFunctionProperties&) const @ 0x00000000190b9b46 22. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:5983: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bbfdf 23. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a24ea 24. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a0a21 25. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0ab1c7 26. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09cd43 27. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001b09af74 28. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr&, std::shared_ptr) @ 0x000000001b09ac33 29. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr) @ 0x000000001b08c3a6 30. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr const&, DB::SelectQueryOptions const&, std::shared_ptr const&, std::shared_ptr const&) @ 0x000000001b507dac 31. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x000000001b5069e6 2024.12.16 10:54:44.047022 [ 5023 ] {6b3d682e-2206-4b24-a260-2751d2514dc1} TCPHandler: Code: 43. DB::Exception: Nested type Tuple(UInt64, UInt64) cannot be inside Nullable type. (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000a8efdf3 6. /build/src/DataTypes/DataTypeNullable.cpp:29: DB::DataTypeNullable::DataTypeNullable(std::shared_ptr const&) @ 0x0000000019f1c60c 7. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::DataTypeNullable* std::construct_at[abi:v15000] const&, DB::DataTypeNullable*>(DB::DataTypeNullable*, std::shared_ptr const&) @ 0x000000001602a8e6 8. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000] const&, void, void>(std::allocator&, DB::DataTypeNullable*, std::shared_ptr const&) @ 0x000000001602a861 9. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000] const&>(std::allocator, std::shared_ptr const&) @ 0x000000001602a7e7 10. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], std::shared_ptr const&, void>(std::allocator const&, std::shared_ptr const&) @ 0x000000001602a717 11. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000] const&, void>(std::shared_ptr const&) @ 0x000000001602a6c6 12. /build/src/AggregateFunctions/Combinators/AggregateFunctionOrFill.h:256: DB::AggregateFunctionOrFill::createResultType(std::shared_ptr const&) @ 0x00000000160290ce 13. /build/src/AggregateFunctions/Combinators/AggregateFunctionOrFill.h:37: DB::AggregateFunctionOrFill::AggregateFunctionOrFill(std::shared_ptr, std::vector, std::allocator>> const&, DB::Array const&) @ 0x0000000016028efd 14. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::AggregateFunctionOrFill* std::construct_at[abi:v15000], std::shared_ptr const&, std::vector, std::allocator>> const&, DB::Array const&, DB::AggregateFunctionOrFill*>(DB::AggregateFunctionOrFill*, std::shared_ptr const&, std::vector, std::allocator>> const&, DB::Array const&) @ 0x0000000016028e89 15. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>>::construct[abi:v15000], std::shared_ptr const&, std::vector, std::allocator>> const&, DB::Array const&, void, void>(std::allocator>&, DB::AggregateFunctionOrFill*, std::shared_ptr const&, std::vector, std::allocator>> const&, DB::Array const&) @ 0x0000000016028c31 16. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace, std::allocator>>::__shared_ptr_emplace[abi:v15000] const&, std::vector, std::allocator>> const&, DB::Array const&>(std::allocator>, std::shared_ptr const&, std::vector, std::allocator>> const&, DB::Array const&) @ 0x0000000016028917 17. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr> std::allocate_shared[abi:v15000], std::allocator>, std::shared_ptr const&, std::vector, std::allocator>> const&, DB::Array const&, void>(std::allocator> const&, std::shared_ptr const&, std::vector, std::allocator>> const&, DB::Array const&) @ 0x000000001602878a 18. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr> std::make_shared[abi:v15000], std::shared_ptr const&, std::vector, std::allocator>> const&, DB::Array const&, void>(std::shared_ptr const&, std::vector, std::allocator>> const&, DB::Array const&) @ 0x00000000160285b6 19. /build/src/AggregateFunctions/Combinators/AggregateFunctionOrFill.cpp:39: DB::(anonymous namespace)::AggregateFunctionCombinatorOrFill::transformAggregateFunction(std::shared_ptr const&, DB::AggregateFunctionProperties const&, std::vector, std::allocator>> const&, DB::Array const&) const @ 0x000000001602825b 20. /build/src/AggregateFunctions/AggregateFunctionFactory.cpp:249: DB::AggregateFunctionFactory::getImpl(String const&, DB::NullsAction, std::vector, std::allocator>> const&, DB::Array const&, DB::AggregateFunctionProperties&, bool) const @ 0x00000000190bb032 21. /build/src/AggregateFunctions/AggregateFunctionFactory.cpp:123: DB::AggregateFunctionFactory::get(String const&, DB::NullsAction, std::vector, std::allocator>> const&, DB::Array const&, DB::AggregateFunctionProperties&) const @ 0x00000000190b9b46 22. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:5983: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bbfdf 23. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a24ea 24. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a0a21 25. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0ab1c7 26. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09cd43 27. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001b09af74 28. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr&, std::shared_ptr) @ 0x000000001b09ac33 29. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr) @ 0x000000001b08c3a6 30. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr const&, DB::SelectQueryOptions const&, std::shared_ptr const&, std::shared_ptr const&) @ 0x000000001b507dac 31. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x000000001b5069e6 2024.12.16 10:54:44.192394 [ 5023 ] {a37b3ed6-553c-4e44-b1f0-d651f342e220} executeQuery: Code: 43. DB::Exception: Nested type Tuple(UInt64, UInt64) cannot be inside Nullable type. (ILLEGAL_TYPE_OF_ARGUMENT) (version 24.3.12.76.altinitystable) (from [::1]:50858) (comment: 02922_respect_nulls_Nullable.sql) (in query: Select anyOrNull(tp) FROM (Select (number, number) as tp from numbers(10));), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000a8efdf3 6. /build/src/DataTypes/DataTypeNullable.cpp:29: DB::DataTypeNullable::DataTypeNullable(std::shared_ptr const&) @ 0x0000000019f1c60c 7. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::DataTypeNullable* std::construct_at[abi:v15000] const&, DB::DataTypeNullable*>(DB::DataTypeNullable*, std::shared_ptr const&) @ 0x000000001602a8e6 8. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000] const&, void, void>(std::allocator&, DB::DataTypeNullable*, std::shared_ptr const&) @ 0x000000001602a861 9. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000] const&>(std::allocator, std::shared_ptr const&) @ 0x000000001602a7e7 10. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], std::shared_ptr const&, void>(std::allocator const&, std::shared_ptr const&) @ 0x000000001602a717 11. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000] const&, void>(std::shared_ptr const&) @ 0x000000001602a6c6 12. /build/src/AggregateFunctions/Combinators/AggregateFunctionOrFill.h:256: DB::AggregateFunctionOrFill::createResultType(std::shared_ptr const&) @ 0x00000000160290ce 13. /build/src/AggregateFunctions/Combinators/AggregateFunctionOrFill.h:37: DB::AggregateFunctionOrFill::AggregateFunctionOrFill(std::shared_ptr, std::vector, std::allocator>> const&, DB::Array const&) @ 0x0000000016028efd 14. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::AggregateFunctionOrFill* std::construct_at[abi:v15000], std::shared_ptr const&, std::vector, std::allocator>> const&, DB::Array const&, DB::AggregateFunctionOrFill*>(DB::AggregateFunctionOrFill*, std::shared_ptr const&, std::vector, std::allocator>> const&, DB::Array const&) @ 0x0000000016028e89 15. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>>::construct[abi:v15000], std::shared_ptr const&, std::vector, std::allocator>> const&, DB::Array const&, void, void>(std::allocator>&, DB::AggregateFunctionOrFill*, std::shared_ptr const&, std::vector, std::allocator>> const&, DB::Array const&) @ 0x0000000016028c31 16. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace, std::allocator>>::__shared_ptr_emplace[abi:v15000] const&, std::vector, std::allocator>> const&, DB::Array const&>(std::allocator>, std::shared_ptr const&, std::vector, std::allocator>> const&, DB::Array const&) @ 0x0000000016028917 17. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr> std::allocate_shared[abi:v15000], std::allocator>, std::shared_ptr const&, std::vector, std::allocator>> const&, DB::Array const&, void>(std::allocator> const&, std::shared_ptr const&, std::vector, std::allocator>> const&, DB::Array const&) @ 0x000000001602878a 18. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr> std::make_shared[abi:v15000], std::shared_ptr const&, std::vector, std::allocator>> const&, DB::Array const&, void>(std::shared_ptr const&, std::vector, std::allocator>> const&, DB::Array const&) @ 0x00000000160285b6 19. /build/src/AggregateFunctions/Combinators/AggregateFunctionOrFill.cpp:39: DB::(anonymous namespace)::AggregateFunctionCombinatorOrFill::transformAggregateFunction(std::shared_ptr const&, DB::AggregateFunctionProperties const&, std::vector, std::allocator>> const&, DB::Array const&) const @ 0x000000001602825b 20. /build/src/AggregateFunctions/AggregateFunctionFactory.cpp:249: DB::AggregateFunctionFactory::getImpl(String const&, DB::NullsAction, std::vector, std::allocator>> const&, DB::Array const&, DB::AggregateFunctionProperties&, bool) const @ 0x00000000190bb032 21. /build/src/AggregateFunctions/AggregateFunctionFactory.cpp:123: DB::AggregateFunctionFactory::get(String const&, DB::NullsAction, std::vector, std::allocator>> const&, DB::Array const&, DB::AggregateFunctionProperties&) const @ 0x00000000190b9b46 22. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:5983: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bbfdf 23. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a24ea 24. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a0a21 25. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0ab1c7 26. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09cd43 27. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001b09af74 28. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr&, std::shared_ptr) @ 0x000000001b09ac33 29. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr) @ 0x000000001b08c3a6 30. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr const&, DB::SelectQueryOptions const&, std::shared_ptr const&, std::shared_ptr const&) @ 0x000000001b507dac 31. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x000000001b5069e6 2024.12.16 10:54:44.211424 [ 5023 ] {a37b3ed6-553c-4e44-b1f0-d651f342e220} TCPHandler: Code: 43. DB::Exception: Nested type Tuple(UInt64, UInt64) cannot be inside Nullable type. (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000a8efdf3 6. /build/src/DataTypes/DataTypeNullable.cpp:29: DB::DataTypeNullable::DataTypeNullable(std::shared_ptr const&) @ 0x0000000019f1c60c 7. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::DataTypeNullable* std::construct_at[abi:v15000] const&, DB::DataTypeNullable*>(DB::DataTypeNullable*, std::shared_ptr const&) @ 0x000000001602a8e6 8. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000] const&, void, void>(std::allocator&, DB::DataTypeNullable*, std::shared_ptr const&) @ 0x000000001602a861 9. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000] const&>(std::allocator, std::shared_ptr const&) @ 0x000000001602a7e7 10. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], std::shared_ptr const&, void>(std::allocator const&, std::shared_ptr const&) @ 0x000000001602a717 11. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000] const&, void>(std::shared_ptr const&) @ 0x000000001602a6c6 12. /build/src/AggregateFunctions/Combinators/AggregateFunctionOrFill.h:256: DB::AggregateFunctionOrFill::createResultType(std::shared_ptr const&) @ 0x00000000160290ce 13. /build/src/AggregateFunctions/Combinators/AggregateFunctionOrFill.h:37: DB::AggregateFunctionOrFill::AggregateFunctionOrFill(std::shared_ptr, std::vector, std::allocator>> const&, DB::Array const&) @ 0x0000000016028efd 14. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::AggregateFunctionOrFill* std::construct_at[abi:v15000], std::shared_ptr const&, std::vector, std::allocator>> const&, DB::Array const&, DB::AggregateFunctionOrFill*>(DB::AggregateFunctionOrFill*, std::shared_ptr const&, std::vector, std::allocator>> const&, DB::Array const&) @ 0x0000000016028e89 15. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>>::construct[abi:v15000], std::shared_ptr const&, std::vector, std::allocator>> const&, DB::Array const&, void, void>(std::allocator>&, DB::AggregateFunctionOrFill*, std::shared_ptr const&, std::vector, std::allocator>> const&, DB::Array const&) @ 0x0000000016028c31 16. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace, std::allocator>>::__shared_ptr_emplace[abi:v15000] const&, std::vector, std::allocator>> const&, DB::Array const&>(std::allocator>, std::shared_ptr const&, std::vector, std::allocator>> const&, DB::Array const&) @ 0x0000000016028917 17. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr> std::allocate_shared[abi:v15000], std::allocator>, std::shared_ptr const&, std::vector, std::allocator>> const&, DB::Array const&, void>(std::allocator> const&, std::shared_ptr const&, std::vector, std::allocator>> const&, DB::Array const&) @ 0x000000001602878a 18. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr> std::make_shared[abi:v15000], std::shared_ptr const&, std::vector, std::allocator>> const&, DB::Array const&, void>(std::shared_ptr const&, std::vector, std::allocator>> const&, DB::Array const&) @ 0x00000000160285b6 19. /build/src/AggregateFunctions/Combinators/AggregateFunctionOrFill.cpp:39: DB::(anonymous namespace)::AggregateFunctionCombinatorOrFill::transformAggregateFunction(std::shared_ptr const&, DB::AggregateFunctionProperties const&, std::vector, std::allocator>> const&, DB::Array const&) const @ 0x000000001602825b 20. /build/src/AggregateFunctions/AggregateFunctionFactory.cpp:249: DB::AggregateFunctionFactory::getImpl(String const&, DB::NullsAction, std::vector, std::allocator>> const&, DB::Array const&, DB::AggregateFunctionProperties&, bool) const @ 0x00000000190bb032 21. /build/src/AggregateFunctions/AggregateFunctionFactory.cpp:123: DB::AggregateFunctionFactory::get(String const&, DB::NullsAction, std::vector, std::allocator>> const&, DB::Array const&, DB::AggregateFunctionProperties&) const @ 0x00000000190b9b46 22. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:5983: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bbfdf 23. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a24ea 24. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a0a21 25. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0ab1c7 26. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09cd43 27. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001b09af74 28. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr&, std::shared_ptr) @ 0x000000001b09ac33 29. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr) @ 0x000000001b08c3a6 30. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr const&, DB::SelectQueryOptions const&, std::shared_ptr const&, std::shared_ptr const&) @ 0x000000001b507dac 31. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x000000001b5069e6 2024.12.16 10:54:44.912288 [ 5023 ] {d98cd2a4-4e6d-44eb-99db-c34fd536a904} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=5, jobs=5). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:50858) (comment: 02922_respect_nulls_Nullable.sql) (in query: SELECT any(tp) AS default, toTypeName(default) as default_type, any(tp) RESPECT NULLS AS respect, toTypeName(respect) as respect_type FROM ( SELECT (toLowCardinality(number), number) AS tp FROM numbers(10) );), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:54:44.940623 [ 5023 ] {d98cd2a4-4e6d-44eb-99db-c34fd536a904} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=5, jobs=5). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:54:45.135154 [ 4182 ] {cecd2bbd-b738-4512-80b6-871eca7d306d} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=11, jobs=1). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:51626) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM system.processes WHERE query_id != queryID() AND current_database = currentDatabase() AND query LIKE '%-- 11317_tuple%'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:54:45.291343 [ 4182 ] {cecd2bbd-b738-4512-80b6-871eca7d306d} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=11, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:54:48.275096 [ 3492 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {6f7c3cf6-8cd3-4e51-9114-2257622df7c4::202412_1_11_2}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:310: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf3ab86 21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37f43 23. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb722bf 24. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb725d8 25. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb71fb2 26. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13ef38 27. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x000000001cba15ed 28. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x000000001cba210e 29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef, StrongTypedef, std::basic_string_view>)::'lambda'()::operator()() const @ 0x000000001cba9c78 30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba9c55 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001cba9c35 (version 24.3.12.76.altinitystable) 2024.12.16 10:54:48.678551 [ 5021 ] {9c9a61d1-6022-4925-adef-532916bd977f} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=28, jobs=28). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:50884) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM system.processes WHERE query_id != queryID() AND current_database = currentDatabase() AND query LIKE '%-- 11317_tuple%'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:54:48.749596 [ 5021 ] {9c9a61d1-6022-4925-adef-532916bd977f} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=28, jobs=28). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:54:52.690290 [ 4401 ] {66813f78-642b-4db7-97f0-d543b062b8ae} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=35, jobs=5). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:38988) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM system.processes WHERE query_id != queryID() AND current_database = currentDatabase() AND query LIKE '%-- 11317_tuple%'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:54:52.786409 [ 3492 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {41d82839-5472-4425-b891-a2dc2a236577::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=5, jobs=0): (while reading column IsBounce): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/41d/41d82839-5472-4425-b891-a2dc2a236577/201403_3_3_0/ in table test.visits (41d82839-5472-4425-b891-a2dc2a236577) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 6608): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe(ThreadPoolImpl>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e92e1 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e917b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e9130 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e90f0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e907b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190eadb1 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e8d90 16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future DB::scheduleFromThreadPoolUnsafe(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl>&, String const&, Priority) @ 0x00000000190e861c 17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e7e3f 18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019365312 19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936561e 20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddc44d 21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6d168 22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6cfbd 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6cf7d 24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6cf3d 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6cf08 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd6a7e 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd2efd 28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fd02d6 29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x0000000019fd045c 30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&) @ 0x000000001ce6ab9b 31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce6a910 (version 24.3.12.76.altinitystable) 2024.12.16 10:54:52.833204 [ 4401 ] {66813f78-642b-4db7-97f0-d543b062b8ae} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=35, jobs=5). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:54:55.201248 [ 4182 ] {ce594974-a7dd-4030-a717-be4c6f3fd6ed} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=862, jobs=796). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:38958) (comment: 01926_bin_unbin.sql) (in query: select unbin('00110000');), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133dc4ad 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d4458 8. /build/src/Common/ThreadPool.cpp:338: ThreadPoolImpl::scheduleOrThrow(std::function, Priority, unsigned long, bool) @ 0x00000000133d4d10 9. /build/src/Common/ThreadPool.h:205: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001d538cf3 10. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:112: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long) @ 0x000000001d538a34 11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:138: DB::PullingAsyncPipelineExecutor::pull(DB::Block&, unsigned long) @ 0x000000001d538de9 12. /build/src/Server/TCPHandler.cpp:1023: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d47ad7f 13. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d47005b 14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 20. ? @ 0x00007f713a222ac3 21. ? @ 0x00007f713a2b4850 2024.12.16 10:54:55.227321 [ 4182 ] {ce594974-a7dd-4030-a717-be4c6f3fd6ed} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=862, jobs=796). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133dc4ad 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d4458 8. /build/src/Common/ThreadPool.cpp:338: ThreadPoolImpl::scheduleOrThrow(std::function, Priority, unsigned long, bool) @ 0x00000000133d4d10 9. /build/src/Common/ThreadPool.h:205: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001d538cf3 10. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:112: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long) @ 0x000000001d538a34 11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:138: DB::PullingAsyncPipelineExecutor::pull(DB::Block&, unsigned long) @ 0x000000001d538de9 12. /build/src/Server/TCPHandler.cpp:1023: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d47ad7f 13. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d47005b 14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 20. ? @ 0x00007f713a222ac3 21. ? @ 0x00007f713a2b4850 2024.12.16 10:54:55.715587 [ 5023 ] {75bb08f6-ede5-46b5-a6c7-3caac149c45d} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:38974) (comment: 03217_filtering_in_system_tables.sql) (in query: CREATE TABLE test_03217_system_tables_replica_2 (`x` UInt32) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{database}/test_03217_system_tables_replica', 'r2') ORDER BY x SETTINGS index_granularity = 58022, min_bytes_for_wide_part = 0, ratio_of_defaults_for_sparse_serialization = 0.861778736114502, replace_long_file_name_to_hash = false, max_file_name_length = 128, min_bytes_for_full_part_storage = 230527396, compact_parts_max_bytes_to_buffer = 263476416, compact_parts_max_granules_to_buffer = 256, compact_parts_merge_max_bytes_to_prefetch_part = 516647, merge_max_block_size = 5506, old_parts_lifetime = 343., prefer_fetch_merged_part_size_threshold = 850479963, vertical_merge_algorithm_min_rows_to_activate = 1, vertical_merge_algorithm_min_columns_to_activate = 100, min_merge_bytes_to_use_direct_io = 1, index_granularity_bytes = 11201918, concurrent_part_removal_threshold = 100, allow_vertical_merges_from_compact_to_wide_parts = false, cache_populated_by_fetch = true, marks_compress_block_size = 61872, primary_key_compress_block_size = 54258), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:169: DB::ThreadPoolCallbackRunnerLocal>, std::function>::operator()(std::function&&, Priority) @ 0x0000000018f68e7a 10. /build/src/Storages/MergeTree/MergeTreeData.cpp:1703: DB::MergeTreeData::loadDataParts(bool, std::optional, std::equal_to, std::allocator>>) @ 0x000000001cbc6877 11. /build/src/Storages/StorageReplicatedMergeTree.cpp:445: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool) @ 0x000000001c4b0f48 12. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageReplicatedMergeTree* std::construct_at[abi:v15000]&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, DB::RenamingRestrictions&, bool&, DB::StorageReplicatedMergeTree*>(DB::StorageReplicatedMergeTree*, String&, String&, DB::LoadingStrictnessLevel const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, DB::RenamingRestrictions&, bool&) @ 0x000000001d0ea038 13. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000]&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, DB::RenamingRestrictions&, bool&, void, void>(std::allocator&, DB::StorageReplicatedMergeTree*, String&, String&, DB::LoadingStrictnessLevel const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, DB::RenamingRestrictions&, bool&) @ 0x000000001d0e9d02 14. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000]&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, DB::RenamingRestrictions&, bool&>(std::allocator, String&, String&, DB::LoadingStrictnessLevel const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, DB::RenamingRestrictions&, bool&) @ 0x000000001d0e9954 15. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], String&, String&, DB::LoadingStrictnessLevel const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, DB::RenamingRestrictions&, bool&, void>(std::allocator const&, String&, String&, DB::LoadingStrictnessLevel const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, DB::RenamingRestrictions&, bool&) @ 0x000000001d0e971f 16. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000]&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, DB::RenamingRestrictions&, bool&, void>(String&, String&, DB::LoadingStrictnessLevel const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, DB::RenamingRestrictions&, bool&) @ 0x000000001d0e7488 17. /build/src/Storages/MergeTree/registerStorageMergeTree.cpp:726: DB::create(DB::StorageFactory::Arguments const&) @ 0x000000001d0e5008 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019307efd 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x0000000019307ebd 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019307e7d 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019307e45 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001c3709de 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001c36f2fd 24. /build/src/Storages/StorageFactory.cpp:224: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, DB::LoadingStrictnessLevel) const @ 0x000000001c36dc1d 25. /build/src/Interpreters/InterpreterCreateQuery.cpp:1493: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x000000001b01e40c 26. /build/src/Interpreters/InterpreterCreateQuery.cpp:1313: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x000000001b018366 27. /build/src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x000000001b021096 28. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 29. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 30. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 31. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 2024.12.16 10:54:55.755935 [ 5023 ] {75bb08f6-ede5-46b5-a6c7-3caac149c45d} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:169: DB::ThreadPoolCallbackRunnerLocal>, std::function>::operator()(std::function&&, Priority) @ 0x0000000018f68e7a 10. /build/src/Storages/MergeTree/MergeTreeData.cpp:1703: DB::MergeTreeData::loadDataParts(bool, std::optional, std::equal_to, std::allocator>>) @ 0x000000001cbc6877 11. /build/src/Storages/StorageReplicatedMergeTree.cpp:445: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool) @ 0x000000001c4b0f48 12. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageReplicatedMergeTree* std::construct_at[abi:v15000]&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, DB::RenamingRestrictions&, bool&, DB::StorageReplicatedMergeTree*>(DB::StorageReplicatedMergeTree*, String&, String&, DB::LoadingStrictnessLevel const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, DB::RenamingRestrictions&, bool&) @ 0x000000001d0ea038 13. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000]&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, DB::RenamingRestrictions&, bool&, void, void>(std::allocator&, DB::StorageReplicatedMergeTree*, String&, String&, DB::LoadingStrictnessLevel const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, DB::RenamingRestrictions&, bool&) @ 0x000000001d0e9d02 14. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000]&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, DB::RenamingRestrictions&, bool&>(std::allocator, String&, String&, DB::LoadingStrictnessLevel const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, DB::RenamingRestrictions&, bool&) @ 0x000000001d0e9954 15. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], String&, String&, DB::LoadingStrictnessLevel const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, DB::RenamingRestrictions&, bool&, void>(std::allocator const&, String&, String&, DB::LoadingStrictnessLevel const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, DB::RenamingRestrictions&, bool&) @ 0x000000001d0e971f 16. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000]&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, DB::RenamingRestrictions&, bool&, void>(String&, String&, DB::LoadingStrictnessLevel const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, DB::RenamingRestrictions&, bool&) @ 0x000000001d0e7488 17. /build/src/Storages/MergeTree/registerStorageMergeTree.cpp:726: DB::create(DB::StorageFactory::Arguments const&) @ 0x000000001d0e5008 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019307efd 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x0000000019307ebd 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019307e7d 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019307e45 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001c3709de 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001c36f2fd 24. /build/src/Storages/StorageFactory.cpp:224: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, DB::LoadingStrictnessLevel) const @ 0x000000001c36dc1d 25. /build/src/Interpreters/InterpreterCreateQuery.cpp:1493: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&) @ 0x000000001b01e40c 26. /build/src/Interpreters/InterpreterCreateQuery.cpp:1313: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x000000001b018366 27. /build/src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x000000001b021096 28. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 29. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 30. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 31. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 2024.12.16 10:54:57.638413 [ 3488 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {41d82839-5472-4425-b891-a2dc2a236577::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=5, jobs=1): (while reading column StartDate): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/41d/41d82839-5472-4425-b891-a2dc2a236577/201403_3_3_0/ in table test.visits (41d82839-5472-4425-b891-a2dc2a236577) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 6608): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe(ThreadPoolImpl>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e92e1 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e917b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e9130 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e90f0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e907b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190eadb1 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e8d90 16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future DB::scheduleFromThreadPoolUnsafe(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl>&, String const&, Priority) @ 0x00000000190e861c 17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e7e3f 18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019365312 19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936561e 20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddc44d 21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6d168 22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6cfbd 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6cf7d 24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6cf3d 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6cf08 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd6a7e 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd2efd 28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fd02d6 29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x0000000019fd045c 30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&) @ 0x000000001ce6ab9b 31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce6a910 (version 24.3.12.76.altinitystable) 2024.12.16 10:55:01.048617 [ 4401 ] {50e85895-9ced-4d17-87ca-25c852e8f7cc} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=12, jobs=12). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:55254) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM system.processes WHERE query_id != queryID() AND current_database = currentDatabase() AND query LIKE '%-- 11317_tuple%'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:55:01.110590 [ 4401 ] {50e85895-9ced-4d17-87ca-25c852e8f7cc} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=12, jobs=12). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:55:01.712963 [ 5021 ] {ebd13875-66a8-4e8b-9b79-f353c3f2787d} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=862, jobs=796). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:55262) (comment: 00167_parallel_parsing_with_names_and_types.sh) (in query: SELECT * FROM parsing_with_names;), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133dc4ad 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d4458 8. /build/src/Common/ThreadPool.cpp:338: ThreadPoolImpl::scheduleOrThrow(std::function, Priority, unsigned long, bool) @ 0x00000000133d4d10 9. /build/src/Common/ThreadPool.h:205: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001d538cf3 10. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:112: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long) @ 0x000000001d538a34 11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:138: DB::PullingAsyncPipelineExecutor::pull(DB::Block&, unsigned long) @ 0x000000001d538de9 12. /build/src/Server/TCPHandler.cpp:1023: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d47ad7f 13. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d47005b 14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 20. ? @ 0x00007f713a222ac3 21. ? @ 0x00007f713a2b4850 2024.12.16 10:55:01.738532 [ 5021 ] {ebd13875-66a8-4e8b-9b79-f353c3f2787d} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=862, jobs=796). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133dc4ad 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d4458 8. /build/src/Common/ThreadPool.cpp:338: ThreadPoolImpl::scheduleOrThrow(std::function, Priority, unsigned long, bool) @ 0x00000000133d4d10 9. /build/src/Common/ThreadPool.h:205: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001d538cf3 10. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:112: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long) @ 0x000000001d538a34 11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:138: DB::PullingAsyncPipelineExecutor::pull(DB::Block&, unsigned long) @ 0x000000001d538de9 12. /build/src/Server/TCPHandler.cpp:1023: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d47ad7f 13. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d47005b 14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 20. ? @ 0x00007f713a222ac3 21. ? @ 0x00007f713a2b4850 2024.12.16 10:55:02.229757 [ 3549 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::TextLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:302: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf3a9cc 21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 (version 24.3.12.76.altinitystable) 2024.12.16 10:55:02.637907 [ 3489 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {41d82839-5472-4425-b891-a2dc2a236577::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=5, jobs=0): (while reading column StartDate): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/41d/41d82839-5472-4425-b891-a2dc2a236577/201403_5_5_0/ in table test.visits (41d82839-5472-4425-b891-a2dc2a236577) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 6739): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe(ThreadPoolImpl>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e92e1 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e917b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e9130 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e90f0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e907b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190eadb1 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e8d90 16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future DB::scheduleFromThreadPoolUnsafe(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl>&, String const&, Priority) @ 0x00000000190e861c 17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e7e3f 18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019365312 19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936561e 20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddc44d 21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6d168 22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6cfbd 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6cf7d 24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6cf3d 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6cf08 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd6a7e 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd2efd 28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fd02d6 29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x0000000019fd045c 30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&) @ 0x000000001ce6ab9b 31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce6a910 (version 24.3.12.76.altinitystable) 2024.12.16 10:55:02.954863 [ 5023 ] {30215c89-e775-49e0-aa34-0bef69bda9b1} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=1). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:55250) (comment: 01035_prewhere_with_alias.sql) (in query: CREATE TABLE audience_local (`Date` Date, `AudienceType` Enum8('other' = 0, 'client' = 1, 'group' = 2), `UMA` UInt64, `APIKey` String, `TrialNameID` UInt32, `TrialGroupID` UInt32, `AppVersion` String, `Arch` Enum8('other' = 0, 'x32' = 1, 'x64' = 2), `UserID` UInt32, `GroupID` UInt8, `OSName` Enum8('other' = 0, 'Android' = 1, 'iOS' = 2, 'macOS' = 3, 'Windows' = 4, 'Linux' = 5), `Channel` Enum8('other' = 0, 'Canary' = 1, 'Dev' = 2, 'Beta' = 3, 'Stable' = 4), `Hits` UInt64, `Sum` Int64, `Release` String ALIAS splitByChar('-', AppVersion)[1]) ENGINE = SummingMergeTree PARTITION BY (toISOYear(Date), toISOWeek(Date)) ORDER BY (AudienceType, UMA, APIKey, Date, TrialNameID, TrialGroupID, AppVersion, Arch, UserID, GroupID, OSName, Channel) SETTINGS index_granularity = 8192, min_bytes_for_wide_part = 1073741824, ratio_of_defaults_for_sparse_serialization = 1., replace_long_file_name_to_hash = false, max_file_name_length = 109, min_bytes_for_full_part_storage = 289651849, compact_parts_max_bytes_to_buffer = 1003941, compact_parts_max_granules_to_buffer = 248, compact_parts_merge_max_bytes_to_prefetch_part = 29421527, merge_max_block_size = 18091, old_parts_lifetime = 474., prefer_fetch_merged_part_size_threshold = 10737418240, vertical_merge_algorithm_min_rows_to_activate = 1, vertical_merge_algorithm_min_columns_to_activate = 2, min_merge_bytes_to_use_direct_io = 1, index_granularity_bytes = 4462246, concurrent_part_removal_threshold = 100, allow_vertical_merges_from_compact_to_wide_parts = true, cache_populated_by_fetch = true, marks_compress_block_size = 30500, primary_key_compress_block_size = 16894), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/IO/WriteBufferFromFileDecorator.cpp:0: DB::WriteBufferFromFileDecorator::finalizeImpl() @ 0x000000001a358847 21. /build/src/Disks/IO/WriteBufferWithFinalizeCallback.cpp:18: DB::WriteBufferWithFinalizeCallback::finalizeImpl() @ 0x000000001a3585b9 22. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 23. /build/src/Storages/MergeTree/MergeTreeData.cpp:306: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x000000001cbadd42 24. /build/src/Storages/StorageMergeTree.cpp:117: DB::StorageMergeTree::StorageMergeTree(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, DB::LoadingStrictnessLevel, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>) @ 0x000000001d0eb1d1 25. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageMergeTree* std::construct_at[abi:v15000]&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, DB::StorageMergeTree*>(DB::StorageMergeTree*, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&) @ 0x000000001d0eabb7 26. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000]&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, void, void>(std::allocator&, DB::StorageMergeTree*, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&) @ 0x000000001d0ea8c7 27. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000]&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>>(std::allocator, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&) @ 0x000000001d0ea575 28. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, void>(std::allocator const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&) @ 0x000000001d0ea3a7 29. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000]&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, void>(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&) @ 0x000000001d0e756d 30. /build/src/Storages/MergeTree/registerStorageMergeTree.cpp:741: DB::create(DB::StorageFactory::Arguments const&) @ 0x000000001d0e50aa 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019307efd 2024.12.16 10:55:02.963574 [ 5023 ] {30215c89-e775-49e0-aa34-0bef69bda9b1} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/IO/WriteBufferFromFileDecorator.cpp:0: DB::WriteBufferFromFileDecorator::finalizeImpl() @ 0x000000001a358847 21. /build/src/Disks/IO/WriteBufferWithFinalizeCallback.cpp:18: DB::WriteBufferWithFinalizeCallback::finalizeImpl() @ 0x000000001a3585b9 22. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 23. /build/src/Storages/MergeTree/MergeTreeData.cpp:306: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x000000001cbadd42 24. /build/src/Storages/StorageMergeTree.cpp:117: DB::StorageMergeTree::StorageMergeTree(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, DB::LoadingStrictnessLevel, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>) @ 0x000000001d0eb1d1 25. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageMergeTree* std::construct_at[abi:v15000]&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, DB::StorageMergeTree*>(DB::StorageMergeTree*, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&) @ 0x000000001d0eabb7 26. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000]&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, void, void>(std::allocator&, DB::StorageMergeTree*, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&) @ 0x000000001d0ea8c7 27. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000]&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>>(std::allocator, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&) @ 0x000000001d0ea575 28. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, void>(std::allocator const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&) @ 0x000000001d0ea3a7 29. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000]&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, void>(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&) @ 0x000000001d0e756d 30. /build/src/Storages/MergeTree/registerStorageMergeTree.cpp:741: DB::create(DB::StorageFactory::Arguments const&) @ 0x000000001d0e50aa 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019307efd 2024.12.16 10:55:03.987251 [ 3482 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {3035f09f-9767-4f79-a76a-3926d52c39f7::202412_1_21_4}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:294: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf3a8b6 21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37f43 23. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb722bf 24. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb725d8 25. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb71fb2 26. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13ef38 27. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x000000001cba15ed 28. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x000000001cba210e 29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef, StrongTypedef, std::basic_string_view>)::'lambda'()::operator()() const @ 0x000000001cba9c78 30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba9c55 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001cba9c35 (version 24.3.12.76.altinitystable) 2024.12.16 10:55:05.026404 [ 5021 ] {90022023-1280-4818-b57f-433392556e04} executeQuery: Code: 36. DB::Exception: Wrong JSON string to merge: Invalid value.: In scope SELECT JSONMergePatch(REPEAT('{"c":', 1000000)). (BAD_ARGUMENTS) (version 24.3.12.76.altinitystable) (from [::1]:55274) (comment: 03217_json_merge_patch_stack_overflow.sql) (in query: SELECT JSONMergePatch(REPEAT('{"c":', 1000000));), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, char const*&&) @ 0x000000000ece6bb3 6. /build/src/Functions/jsonMergePatch.cpp:105: DB::(anonymous namespace)::FunctionJSONMergePatch::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const::'lambda'(DB::ColumnString const&, rapidjson::GenericDocument, rapidjson::MemoryPoolAllocator, rapidjson::CrtAllocator>&, unsigned long)::operator()(DB::ColumnString const&, rapidjson::GenericDocument, rapidjson::MemoryPoolAllocator, rapidjson::CrtAllocator>&, unsigned long) const @ 0x000000000ece3058 7. /build/src/Functions/jsonMergePatch.cpp:128: DB::(anonymous namespace)::FunctionJSONMergePatch::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000ece2580 8. /build/src/Functions/IFunction.h:443: DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000a8ef299 9. /build/src/Functions/IFunctionAdaptors.h:26: DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000af6a9ad 10. /build/src/Functions/IFunction.cpp:277: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019062706 11. /build/src/Functions/IFunction.cpp:191: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019062283 12. /build/src/Functions/IFunction.cpp:269: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x00000000190625e3 13. /build/src/Functions/IFunction.cpp:336: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019063826 14. /build/src/Functions/IFunction.cpp:411: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x00000000190648b5 15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6185: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bdb89 16. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a24ea 17. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a0a21 18. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0ab1c7 19. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09cd43 20. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001b09af74 21. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr&, std::shared_ptr) @ 0x000000001b09ac33 22. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr) @ 0x000000001b08c3a6 23. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr const&, DB::SelectQueryOptions const&, std::shared_ptr const&, std::shared_ptr const&) @ 0x000000001b507dac 24. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x000000001b5069e6 25. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr const&, DB::SelectQueryOptions const&) @ 0x000000001b509db7 26. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50924c 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b5091fd 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b50919d 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b50915d 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b509125 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b428b1e 2024.12.16 10:55:05.361816 [ 5021 ] {90022023-1280-4818-b57f-433392556e04} TCPHandler: Code: 36. DB::Exception: Wrong JSON string to merge: Invalid value.: In scope SELECT JSONMergePatch(REPEAT('{"c":', 1000000)). (BAD_ARGUMENTS), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, char const*&&) @ 0x000000000ece6bb3 6. /build/src/Functions/jsonMergePatch.cpp:105: DB::(anonymous namespace)::FunctionJSONMergePatch::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const::'lambda'(DB::ColumnString const&, rapidjson::GenericDocument, rapidjson::MemoryPoolAllocator, rapidjson::CrtAllocator>&, unsigned long)::operator()(DB::ColumnString const&, rapidjson::GenericDocument, rapidjson::MemoryPoolAllocator, rapidjson::CrtAllocator>&, unsigned long) const @ 0x000000000ece3058 7. /build/src/Functions/jsonMergePatch.cpp:128: DB::(anonymous namespace)::FunctionJSONMergePatch::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000ece2580 8. /build/src/Functions/IFunction.h:443: DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000a8ef299 9. /build/src/Functions/IFunctionAdaptors.h:26: DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000af6a9ad 10. /build/src/Functions/IFunction.cpp:277: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019062706 11. /build/src/Functions/IFunction.cpp:191: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019062283 12. /build/src/Functions/IFunction.cpp:269: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x00000000190625e3 13. /build/src/Functions/IFunction.cpp:336: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019063826 14. /build/src/Functions/IFunction.cpp:411: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x00000000190648b5 15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6185: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bdb89 16. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a24ea 17. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a0a21 18. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0ab1c7 19. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09cd43 20. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001b09af74 21. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr&, std::shared_ptr) @ 0x000000001b09ac33 22. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr) @ 0x000000001b08c3a6 23. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr const&, DB::SelectQueryOptions const&, std::shared_ptr const&, std::shared_ptr const&) @ 0x000000001b507dac 24. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x000000001b5069e6 25. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr const&, DB::SelectQueryOptions const&) @ 0x000000001b509db7 26. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50924c 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b5091fd 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b50919d 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b50915d 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b509125 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b428b1e 2024.12.16 10:55:05.399305 [ 5023 ] {5cca0642-a799-4848-8a73-1fec1b2c6186} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=41, jobs=41). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:55278) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM system.processes WHERE query_id != queryID() AND current_database = currentDatabase() AND query LIKE '%-- 11317_tuple%'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:55:05.443963 [ 5023 ] {5cca0642-a799-4848-8a73-1fec1b2c6186} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=41, jobs=41). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:55:05.444281 [ 3493 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {3fad45aa-c6fd-41ee-8fe5-5d48f1e42f6c::202412_1_21_4}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:296: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd2e93 21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set, std::equal_to, std::allocator>&) @ 0x000000001ccd371a 22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf3803a 23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37f43 24. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb722bf 25. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb725d8 26. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb71fb2 27. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13ef38 28. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x000000001cba15ed 29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x000000001cba210e 30. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef, StrongTypedef, std::basic_string_view>)::'lambda'()::operator()() const @ 0x000000001cba9c78 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba9c55 (version 24.3.12.76.altinitystable) 2024.12.16 10:55:05.799132 [ 5021 ] {44512473-32ab-437b-842a-a1e22bb4cb04} executeQuery: Code: 36. DB::Exception: Wrong JSON string to merge: Invalid value.: In scope SELECT JSONMergePatch(REPEAT('{"c":', 100000)). (BAD_ARGUMENTS) (version 24.3.12.76.altinitystable) (from [::1]:55274) (comment: 03217_json_merge_patch_stack_overflow.sql) (in query: SELECT JSONMergePatch(REPEAT('{"c":', 100000));), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, char const*&&) @ 0x000000000ece6bb3 6. /build/src/Functions/jsonMergePatch.cpp:105: DB::(anonymous namespace)::FunctionJSONMergePatch::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const::'lambda'(DB::ColumnString const&, rapidjson::GenericDocument, rapidjson::MemoryPoolAllocator, rapidjson::CrtAllocator>&, unsigned long)::operator()(DB::ColumnString const&, rapidjson::GenericDocument, rapidjson::MemoryPoolAllocator, rapidjson::CrtAllocator>&, unsigned long) const @ 0x000000000ece3058 7. /build/src/Functions/jsonMergePatch.cpp:128: DB::(anonymous namespace)::FunctionJSONMergePatch::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000ece2580 8. /build/src/Functions/IFunction.h:443: DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000a8ef299 9. /build/src/Functions/IFunctionAdaptors.h:26: DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000af6a9ad 10. /build/src/Functions/IFunction.cpp:277: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019062706 11. /build/src/Functions/IFunction.cpp:191: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019062283 12. /build/src/Functions/IFunction.cpp:269: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x00000000190625e3 13. /build/src/Functions/IFunction.cpp:336: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019063826 14. /build/src/Functions/IFunction.cpp:411: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x00000000190648b5 15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6185: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bdb89 16. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a24ea 17. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a0a21 18. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0ab1c7 19. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09cd43 20. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001b09af74 21. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr&, std::shared_ptr) @ 0x000000001b09ac33 22. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr) @ 0x000000001b08c3a6 23. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr const&, DB::SelectQueryOptions const&, std::shared_ptr const&, std::shared_ptr const&) @ 0x000000001b507dac 24. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x000000001b5069e6 25. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr const&, DB::SelectQueryOptions const&) @ 0x000000001b509db7 26. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50924c 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b5091fd 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b50919d 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b50915d 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b509125 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b428b1e 2024.12.16 10:55:05.808215 [ 5021 ] {44512473-32ab-437b-842a-a1e22bb4cb04} TCPHandler: Code: 36. DB::Exception: Wrong JSON string to merge: Invalid value.: In scope SELECT JSONMergePatch(REPEAT('{"c":', 100000)). (BAD_ARGUMENTS), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, char const*&&) @ 0x000000000ece6bb3 6. /build/src/Functions/jsonMergePatch.cpp:105: DB::(anonymous namespace)::FunctionJSONMergePatch::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const::'lambda'(DB::ColumnString const&, rapidjson::GenericDocument, rapidjson::MemoryPoolAllocator, rapidjson::CrtAllocator>&, unsigned long)::operator()(DB::ColumnString const&, rapidjson::GenericDocument, rapidjson::MemoryPoolAllocator, rapidjson::CrtAllocator>&, unsigned long) const @ 0x000000000ece3058 7. /build/src/Functions/jsonMergePatch.cpp:128: DB::(anonymous namespace)::FunctionJSONMergePatch::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000ece2580 8. /build/src/Functions/IFunction.h:443: DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000a8ef299 9. /build/src/Functions/IFunctionAdaptors.h:26: DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000af6a9ad 10. /build/src/Functions/IFunction.cpp:277: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019062706 11. /build/src/Functions/IFunction.cpp:191: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019062283 12. /build/src/Functions/IFunction.cpp:269: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x00000000190625e3 13. /build/src/Functions/IFunction.cpp:336: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019063826 14. /build/src/Functions/IFunction.cpp:411: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x00000000190648b5 15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6185: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bdb89 16. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a24ea 17. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a0a21 18. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0ab1c7 19. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09cd43 20. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001b09af74 21. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr&, std::shared_ptr) @ 0x000000001b09ac33 22. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr) @ 0x000000001b08c3a6 23. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr const&, DB::SelectQueryOptions const&, std::shared_ptr const&, std::shared_ptr const&) @ 0x000000001b507dac 24. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x000000001b5069e6 25. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr const&, DB::SelectQueryOptions const&) @ 0x000000001b509db7 26. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50924c 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b5091fd 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b50919d 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b50915d 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b509125 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b428b1e 2024.12.16 10:55:06.142140 [ 3485 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {3fad45aa-c6fd-41ee-8fe5-5d48f1e42f6c::202412_1_21_4}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=30, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1fc91 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1fb3b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1faf0 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1fab0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1fa3b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce216d1 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1f750 16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future> DB::scheduleFromThreadPoolUnsafe, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl>&, String const&, Priority) @ 0x000000001ce1f09c 17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1d6c3 18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl>*, unsigned long) @ 0x000000001ce1d5b3 19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*, unsigned long, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&&, unsigned long&&) @ 0x000000001ce56a2c 20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*, unsigned long, void, void>(std::allocator&, DB::MergeTreeMarksLoader*, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&&, unsigned long&&) @ 0x000000001ce56935 21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*, unsigned long>(std::allocator, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&&, unsigned long&&) @ 0x000000001ce56863 22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], std::shared_ptr&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*, unsigned long, void>(std::allocator const&, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&&, unsigned long&&) @ 0x000000001ce56715 23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*, unsigned long, void>(std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&&, unsigned long&&) @ 0x000000001ce53cbb 24. /build/src/Storages/MergeTree/MergeTreeReaderCompact.cpp:37: DB::MergeTreeReaderCompact::MergeTreeReaderCompact(std::shared_ptr, DB::NamesAndTypesList, std::unordered_map, std::equal_to, std::allocator>> const&, std::shared_ptr const&, DB::UncompressedCache*, DB::MarkCache*, DB::MarkRanges, DB::MergeTreeReaderSettings, std::map, std::allocator>>, std::function const&, int) @ 0x000000001ce51f0a 25. /build/src/Storages/MergeTree/MergeTreeReaderCompactSingleBuffer.h:16: DB::MergeTreeReaderCompactSingleBuffer::MergeTreeReaderCompactSingleBuffer&, DB::NamesAndTypesList const&, std::unordered_map, std::equal_to, std::allocator>> const&, std::shared_ptr const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map, std::allocator>> const&, std::function const&, int>(std::shared_ptr&, DB::NamesAndTypesList const&, std::unordered_map, std::equal_to, std::allocator>> const&, std::shared_ptr const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map, std::allocator>> const&, std::function const&, int&&) @ 0x000000001ccc27a5 26. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, DB::NamesAndTypesList const&, std::unordered_map, std::equal_to, std::allocator>> const&, std::shared_ptr const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map, std::allocator>> const&, std::function const&, int>(std::shared_ptr&, DB::NamesAndTypesList const&, std::unordered_map, std::equal_to, std::allocator>> const&, std::shared_ptr const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map, std::allocator>> const&, std::function const&, int&&) @ 0x000000001ccc1b7d 27. /build/src/Storages/MergeTree/MergeTreeDataPartCompact.cpp:43: DB::MergeTreeDataPartCompact::getReader(DB::NamesAndTypesList const&, std::shared_ptr const&, DB::MarkRanges const&, std::unordered_map, std::equal_to, std::allocator>> const&, DB::UncompressedCache*, DB::MarkCache*, std::shared_ptr const&, DB::MergeTreeReaderSettings const&, std::map, std::allocator>> const&, std::function const&) const @ 0x000000001ccbeef3 28. /build/src/Storages/MergeTree/MergeTreeSequentialSource.cpp:177: DB::MergeTreeSequentialSource::MergeTreeSequentialSource(DB::MergeTreeSequentialSourceType, DB::MergeTreeData const&, std::shared_ptr const&, std::shared_ptr, std::vector>, std::optional, bool, bool, bool, bool) @ 0x000000001ce71ef0 29. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeSequentialSource* std::construct_at[abi:v15000] const&, std::shared_ptr&, std::vector>&, std::optional, bool, bool&, bool&, bool&, DB::MergeTreeSequentialSource*>(DB::MergeTreeSequentialSource*, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr const&, std::shared_ptr&, std::vector>&, std::optional&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce76047 30. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000] const&, std::shared_ptr&, std::vector>&, std::optional, bool, bool&, bool&, bool&, void, void>(std::allocator&, DB::MergeTreeSequentialSource*, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr const&, std::shared_ptr&, std::vector>&, std::optional&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce75d04 31. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000] const&, std::shared_ptr&, std::vector>&, std::optional, bool, bool&, bool&, bool&>(std::allocator, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr const&, std::shared_ptr&, std::vector>&, std::optional&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce759b1 (version 24.3.12.76.altinitystable) 2024.12.16 10:55:06.127756 [ 5021 ] {c5ee7286-e890-46f0-bad3-b50cde1073d1} executeQuery: Code: 36. DB::Exception: Wrong JSON string to merge: Invalid value.: In scope SELECT JSONMergePatch(REPEAT('{"c":', 10000)). (BAD_ARGUMENTS) (version 24.3.12.76.altinitystable) (from [::1]:55274) (comment: 03217_json_merge_patch_stack_overflow.sql) (in query: SELECT JSONMergePatch(REPEAT('{"c":', 10000));), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, char const*&&) @ 0x000000000ece6bb3 6. /build/src/Functions/jsonMergePatch.cpp:105: DB::(anonymous namespace)::FunctionJSONMergePatch::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const::'lambda'(DB::ColumnString const&, rapidjson::GenericDocument, rapidjson::MemoryPoolAllocator, rapidjson::CrtAllocator>&, unsigned long)::operator()(DB::ColumnString const&, rapidjson::GenericDocument, rapidjson::MemoryPoolAllocator, rapidjson::CrtAllocator>&, unsigned long) const @ 0x000000000ece3058 7. /build/src/Functions/jsonMergePatch.cpp:128: DB::(anonymous namespace)::FunctionJSONMergePatch::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000ece2580 8. /build/src/Functions/IFunction.h:443: DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000a8ef299 9. /build/src/Functions/IFunctionAdaptors.h:26: DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000af6a9ad 10. /build/src/Functions/IFunction.cpp:277: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019062706 11. /build/src/Functions/IFunction.cpp:191: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019062283 12. /build/src/Functions/IFunction.cpp:269: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x00000000190625e3 13. /build/src/Functions/IFunction.cpp:336: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019063826 14. /build/src/Functions/IFunction.cpp:411: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x00000000190648b5 15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6185: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bdb89 16. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a24ea 17. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a0a21 18. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0ab1c7 19. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09cd43 20. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001b09af74 21. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr&, std::shared_ptr) @ 0x000000001b09ac33 22. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr) @ 0x000000001b08c3a6 23. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr const&, DB::SelectQueryOptions const&, std::shared_ptr const&, std::shared_ptr const&) @ 0x000000001b507dac 24. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x000000001b5069e6 25. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr const&, DB::SelectQueryOptions const&) @ 0x000000001b509db7 26. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50924c 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b5091fd 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b50919d 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b50915d 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b509125 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b428b1e 2024.12.16 10:55:06.149525 [ 5021 ] {c5ee7286-e890-46f0-bad3-b50cde1073d1} TCPHandler: Code: 36. DB::Exception: Wrong JSON string to merge: Invalid value.: In scope SELECT JSONMergePatch(REPEAT('{"c":', 10000)). (BAD_ARGUMENTS), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, char const*&&) @ 0x000000000ece6bb3 6. /build/src/Functions/jsonMergePatch.cpp:105: DB::(anonymous namespace)::FunctionJSONMergePatch::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const::'lambda'(DB::ColumnString const&, rapidjson::GenericDocument, rapidjson::MemoryPoolAllocator, rapidjson::CrtAllocator>&, unsigned long)::operator()(DB::ColumnString const&, rapidjson::GenericDocument, rapidjson::MemoryPoolAllocator, rapidjson::CrtAllocator>&, unsigned long) const @ 0x000000000ece3058 7. /build/src/Functions/jsonMergePatch.cpp:128: DB::(anonymous namespace)::FunctionJSONMergePatch::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000ece2580 8. /build/src/Functions/IFunction.h:443: DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000a8ef299 9. /build/src/Functions/IFunctionAdaptors.h:26: DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000af6a9ad 10. /build/src/Functions/IFunction.cpp:277: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019062706 11. /build/src/Functions/IFunction.cpp:191: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019062283 12. /build/src/Functions/IFunction.cpp:269: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x00000000190625e3 13. /build/src/Functions/IFunction.cpp:336: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019063826 14. /build/src/Functions/IFunction.cpp:411: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x00000000190648b5 15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6185: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bdb89 16. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a24ea 17. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a0a21 18. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0ab1c7 19. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09cd43 20. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001b09af74 21. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr&, std::shared_ptr) @ 0x000000001b09ac33 22. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr) @ 0x000000001b08c3a6 23. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr const&, DB::SelectQueryOptions const&, std::shared_ptr const&, std::shared_ptr const&) @ 0x000000001b507dac 24. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x000000001b5069e6 25. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr const&, DB::SelectQueryOptions const&) @ 0x000000001b509db7 26. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50924c 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b5091fd 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b50919d 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b50915d 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b509125 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b428b1e 2024.12.16 10:55:06.390468 [ 5021 ] {fbcfa810-9ee1-4d73-9749-122be152b08e} executeQuery: Code: 36. DB::Exception: Wrong JSON string to merge: Invalid value.: In scope SELECT JSONMergePatch(REPEAT('{"c":', 1000)). (BAD_ARGUMENTS) (version 24.3.12.76.altinitystable) (from [::1]:55274) (comment: 03217_json_merge_patch_stack_overflow.sql) (in query: SELECT JSONMergePatch(REPEAT('{"c":', 1000));), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, char const*&&) @ 0x000000000ece6bb3 6. /build/src/Functions/jsonMergePatch.cpp:105: DB::(anonymous namespace)::FunctionJSONMergePatch::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const::'lambda'(DB::ColumnString const&, rapidjson::GenericDocument, rapidjson::MemoryPoolAllocator, rapidjson::CrtAllocator>&, unsigned long)::operator()(DB::ColumnString const&, rapidjson::GenericDocument, rapidjson::MemoryPoolAllocator, rapidjson::CrtAllocator>&, unsigned long) const @ 0x000000000ece3058 7. /build/src/Functions/jsonMergePatch.cpp:128: DB::(anonymous namespace)::FunctionJSONMergePatch::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000ece2580 8. /build/src/Functions/IFunction.h:443: DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000a8ef299 9. /build/src/Functions/IFunctionAdaptors.h:26: DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000af6a9ad 10. /build/src/Functions/IFunction.cpp:277: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019062706 11. /build/src/Functions/IFunction.cpp:191: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019062283 12. /build/src/Functions/IFunction.cpp:269: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x00000000190625e3 13. /build/src/Functions/IFunction.cpp:336: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019063826 14. /build/src/Functions/IFunction.cpp:411: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x00000000190648b5 15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6185: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bdb89 16. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a24ea 17. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a0a21 18. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0ab1c7 19. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09cd43 20. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001b09af74 21. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr&, std::shared_ptr) @ 0x000000001b09ac33 22. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr) @ 0x000000001b08c3a6 23. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr const&, DB::SelectQueryOptions const&, std::shared_ptr const&, std::shared_ptr const&) @ 0x000000001b507dac 24. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x000000001b5069e6 25. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr const&, DB::SelectQueryOptions const&) @ 0x000000001b509db7 26. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50924c 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b5091fd 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b50919d 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b50915d 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b509125 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b428b1e 2024.12.16 10:55:06.409450 [ 5021 ] {fbcfa810-9ee1-4d73-9749-122be152b08e} TCPHandler: Code: 36. DB::Exception: Wrong JSON string to merge: Invalid value.: In scope SELECT JSONMergePatch(REPEAT('{"c":', 1000)). (BAD_ARGUMENTS), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, char const*&&) @ 0x000000000ece6bb3 6. /build/src/Functions/jsonMergePatch.cpp:105: DB::(anonymous namespace)::FunctionJSONMergePatch::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const::'lambda'(DB::ColumnString const&, rapidjson::GenericDocument, rapidjson::MemoryPoolAllocator, rapidjson::CrtAllocator>&, unsigned long)::operator()(DB::ColumnString const&, rapidjson::GenericDocument, rapidjson::MemoryPoolAllocator, rapidjson::CrtAllocator>&, unsigned long) const @ 0x000000000ece3058 7. /build/src/Functions/jsonMergePatch.cpp:128: DB::(anonymous namespace)::FunctionJSONMergePatch::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000ece2580 8. /build/src/Functions/IFunction.h:443: DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000a8ef299 9. /build/src/Functions/IFunctionAdaptors.h:26: DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000af6a9ad 10. /build/src/Functions/IFunction.cpp:277: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019062706 11. /build/src/Functions/IFunction.cpp:191: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019062283 12. /build/src/Functions/IFunction.cpp:269: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x00000000190625e3 13. /build/src/Functions/IFunction.cpp:336: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019063826 14. /build/src/Functions/IFunction.cpp:411: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x00000000190648b5 15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6185: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bdb89 16. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a24ea 17. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a0a21 18. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0ab1c7 19. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09cd43 20. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001b09af74 21. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr&, std::shared_ptr) @ 0x000000001b09ac33 22. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr) @ 0x000000001b08c3a6 23. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr const&, DB::SelectQueryOptions const&, std::shared_ptr const&, std::shared_ptr const&) @ 0x000000001b507dac 24. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x000000001b5069e6 25. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr const&, DB::SelectQueryOptions const&) @ 0x000000001b509db7 26. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50924c 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b5091fd 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b50919d 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b50915d 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b509125 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b428b1e 2024.12.16 10:55:06.732352 [ 5021 ] {abf0b4ac-340d-40ab-800e-2688c5e9cd2b} executeQuery: Code: 36. DB::Exception: Wrong JSON string to merge: Invalid value.: In scope SELECT JSONMergePatch(REPEAT('{"c":', 100)). (BAD_ARGUMENTS) (version 24.3.12.76.altinitystable) (from [::1]:55274) (comment: 03217_json_merge_patch_stack_overflow.sql) (in query: SELECT JSONMergePatch(REPEAT('{"c":', 100));), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, char const*&&) @ 0x000000000ece6bb3 6. /build/src/Functions/jsonMergePatch.cpp:105: DB::(anonymous namespace)::FunctionJSONMergePatch::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const::'lambda'(DB::ColumnString const&, rapidjson::GenericDocument, rapidjson::MemoryPoolAllocator, rapidjson::CrtAllocator>&, unsigned long)::operator()(DB::ColumnString const&, rapidjson::GenericDocument, rapidjson::MemoryPoolAllocator, rapidjson::CrtAllocator>&, unsigned long) const @ 0x000000000ece3058 7. /build/src/Functions/jsonMergePatch.cpp:128: DB::(anonymous namespace)::FunctionJSONMergePatch::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000ece2580 8. /build/src/Functions/IFunction.h:443: DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000a8ef299 9. /build/src/Functions/IFunctionAdaptors.h:26: DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000af6a9ad 10. /build/src/Functions/IFunction.cpp:277: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019062706 11. /build/src/Functions/IFunction.cpp:191: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019062283 12. /build/src/Functions/IFunction.cpp:269: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x00000000190625e3 13. /build/src/Functions/IFunction.cpp:336: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019063826 14. /build/src/Functions/IFunction.cpp:411: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x00000000190648b5 15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6185: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bdb89 16. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a24ea 17. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a0a21 18. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0ab1c7 19. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09cd43 20. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001b09af74 21. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr&, std::shared_ptr) @ 0x000000001b09ac33 22. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr) @ 0x000000001b08c3a6 23. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr const&, DB::SelectQueryOptions const&, std::shared_ptr const&, std::shared_ptr const&) @ 0x000000001b507dac 24. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x000000001b5069e6 25. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr const&, DB::SelectQueryOptions const&) @ 0x000000001b509db7 26. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50924c 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b5091fd 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b50919d 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b50915d 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b509125 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b428b1e 2024.12.16 10:55:06.738798 [ 5021 ] {abf0b4ac-340d-40ab-800e-2688c5e9cd2b} TCPHandler: Code: 36. DB::Exception: Wrong JSON string to merge: Invalid value.: In scope SELECT JSONMergePatch(REPEAT('{"c":', 100)). (BAD_ARGUMENTS), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, char const*&&) @ 0x000000000ece6bb3 6. /build/src/Functions/jsonMergePatch.cpp:105: DB::(anonymous namespace)::FunctionJSONMergePatch::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const::'lambda'(DB::ColumnString const&, rapidjson::GenericDocument, rapidjson::MemoryPoolAllocator, rapidjson::CrtAllocator>&, unsigned long)::operator()(DB::ColumnString const&, rapidjson::GenericDocument, rapidjson::MemoryPoolAllocator, rapidjson::CrtAllocator>&, unsigned long) const @ 0x000000000ece3058 7. /build/src/Functions/jsonMergePatch.cpp:128: DB::(anonymous namespace)::FunctionJSONMergePatch::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000ece2580 8. /build/src/Functions/IFunction.h:443: DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000a8ef299 9. /build/src/Functions/IFunctionAdaptors.h:26: DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000af6a9ad 10. /build/src/Functions/IFunction.cpp:277: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019062706 11. /build/src/Functions/IFunction.cpp:191: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019062283 12. /build/src/Functions/IFunction.cpp:269: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x00000000190625e3 13. /build/src/Functions/IFunction.cpp:336: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019063826 14. /build/src/Functions/IFunction.cpp:411: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x00000000190648b5 15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6185: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bdb89 16. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a24ea 17. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a0a21 18. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0ab1c7 19. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09cd43 20. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001b09af74 21. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr&, std::shared_ptr) @ 0x000000001b09ac33 22. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr) @ 0x000000001b08c3a6 23. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr const&, DB::SelectQueryOptions const&, std::shared_ptr const&, std::shared_ptr const&) @ 0x000000001b507dac 24. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x000000001b5069e6 25. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr const&, DB::SelectQueryOptions const&) @ 0x000000001b509db7 26. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50924c 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b5091fd 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b50919d 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b50915d 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b509125 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b428b1e 2024.12.16 10:55:06.973861 [ 5021 ] {880d9cb6-2831-49c6-bf74-1b13979aa984} executeQuery: Code: 36. DB::Exception: Wrong JSON string to merge: Invalid value.: In scope SELECT JSONMergePatch(REPEAT('{"c":', 10)). (BAD_ARGUMENTS) (version 24.3.12.76.altinitystable) (from [::1]:55274) (comment: 03217_json_merge_patch_stack_overflow.sql) (in query: SELECT JSONMergePatch(REPEAT('{"c":', 10));), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, char const*&&) @ 0x000000000ece6bb3 6. /build/src/Functions/jsonMergePatch.cpp:105: DB::(anonymous namespace)::FunctionJSONMergePatch::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const::'lambda'(DB::ColumnString const&, rapidjson::GenericDocument, rapidjson::MemoryPoolAllocator, rapidjson::CrtAllocator>&, unsigned long)::operator()(DB::ColumnString const&, rapidjson::GenericDocument, rapidjson::MemoryPoolAllocator, rapidjson::CrtAllocator>&, unsigned long) const @ 0x000000000ece3058 7. /build/src/Functions/jsonMergePatch.cpp:128: DB::(anonymous namespace)::FunctionJSONMergePatch::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000ece2580 8. /build/src/Functions/IFunction.h:443: DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000a8ef299 9. /build/src/Functions/IFunctionAdaptors.h:26: DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000af6a9ad 10. /build/src/Functions/IFunction.cpp:277: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019062706 11. /build/src/Functions/IFunction.cpp:191: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019062283 12. /build/src/Functions/IFunction.cpp:269: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x00000000190625e3 13. /build/src/Functions/IFunction.cpp:336: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019063826 14. /build/src/Functions/IFunction.cpp:411: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x00000000190648b5 15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6185: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bdb89 16. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a24ea 17. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a0a21 18. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0ab1c7 19. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09cd43 20. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001b09af74 21. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr&, std::shared_ptr) @ 0x000000001b09ac33 22. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr) @ 0x000000001b08c3a6 23. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr const&, DB::SelectQueryOptions const&, std::shared_ptr const&, std::shared_ptr const&) @ 0x000000001b507dac 24. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x000000001b5069e6 25. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr const&, DB::SelectQueryOptions const&) @ 0x000000001b509db7 26. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50924c 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b5091fd 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b50919d 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b50915d 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b509125 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b428b1e 2024.12.16 10:55:06.988298 [ 5021 ] {880d9cb6-2831-49c6-bf74-1b13979aa984} TCPHandler: Code: 36. DB::Exception: Wrong JSON string to merge: Invalid value.: In scope SELECT JSONMergePatch(REPEAT('{"c":', 10)). (BAD_ARGUMENTS), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, char const*&&) @ 0x000000000ece6bb3 6. /build/src/Functions/jsonMergePatch.cpp:105: DB::(anonymous namespace)::FunctionJSONMergePatch::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const::'lambda'(DB::ColumnString const&, rapidjson::GenericDocument, rapidjson::MemoryPoolAllocator, rapidjson::CrtAllocator>&, unsigned long)::operator()(DB::ColumnString const&, rapidjson::GenericDocument, rapidjson::MemoryPoolAllocator, rapidjson::CrtAllocator>&, unsigned long) const @ 0x000000000ece3058 7. /build/src/Functions/jsonMergePatch.cpp:128: DB::(anonymous namespace)::FunctionJSONMergePatch::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000ece2580 8. /build/src/Functions/IFunction.h:443: DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000a8ef299 9. /build/src/Functions/IFunctionAdaptors.h:26: DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000af6a9ad 10. /build/src/Functions/IFunction.cpp:277: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019062706 11. /build/src/Functions/IFunction.cpp:191: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019062283 12. /build/src/Functions/IFunction.cpp:269: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x00000000190625e3 13. /build/src/Functions/IFunction.cpp:336: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019063826 14. /build/src/Functions/IFunction.cpp:411: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x00000000190648b5 15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6185: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bdb89 16. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a24ea 17. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a0a21 18. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0ab1c7 19. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09cd43 20. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001b09af74 21. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr&, std::shared_ptr) @ 0x000000001b09ac33 22. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr) @ 0x000000001b08c3a6 23. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr const&, DB::SelectQueryOptions const&, std::shared_ptr const&, std::shared_ptr const&) @ 0x000000001b507dac 24. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x000000001b5069e6 25. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr const&, DB::SelectQueryOptions const&) @ 0x000000001b509db7 26. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50924c 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b5091fd 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b50919d 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b50915d 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b509125 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b428b1e 2024.12.16 10:55:07.202427 [ 5021 ] {e04afca6-09bd-4787-94e2-3cf2219d6c10} executeQuery: Code: 36. DB::Exception: Wrong JSON string to merge: Invalid value.: In scope SELECT JSONMergePatch(REPEAT('{"c":', 1)). (BAD_ARGUMENTS) (version 24.3.12.76.altinitystable) (from [::1]:55274) (comment: 03217_json_merge_patch_stack_overflow.sql) (in query: SELECT JSONMergePatch(REPEAT('{"c":', 1));), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, char const*&&) @ 0x000000000ece6bb3 6. /build/src/Functions/jsonMergePatch.cpp:105: DB::(anonymous namespace)::FunctionJSONMergePatch::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const::'lambda'(DB::ColumnString const&, rapidjson::GenericDocument, rapidjson::MemoryPoolAllocator, rapidjson::CrtAllocator>&, unsigned long)::operator()(DB::ColumnString const&, rapidjson::GenericDocument, rapidjson::MemoryPoolAllocator, rapidjson::CrtAllocator>&, unsigned long) const @ 0x000000000ece3058 7. /build/src/Functions/jsonMergePatch.cpp:128: DB::(anonymous namespace)::FunctionJSONMergePatch::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000ece2580 8. /build/src/Functions/IFunction.h:443: DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000a8ef299 9. /build/src/Functions/IFunctionAdaptors.h:26: DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000af6a9ad 10. /build/src/Functions/IFunction.cpp:277: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019062706 11. /build/src/Functions/IFunction.cpp:191: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019062283 12. /build/src/Functions/IFunction.cpp:269: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x00000000190625e3 13. /build/src/Functions/IFunction.cpp:336: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019063826 14. /build/src/Functions/IFunction.cpp:411: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x00000000190648b5 15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6185: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bdb89 16. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a24ea 17. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a0a21 18. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0ab1c7 19. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09cd43 20. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001b09af74 21. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr&, std::shared_ptr) @ 0x000000001b09ac33 22. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr) @ 0x000000001b08c3a6 23. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr const&, DB::SelectQueryOptions const&, std::shared_ptr const&, std::shared_ptr const&) @ 0x000000001b507dac 24. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x000000001b5069e6 25. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr const&, DB::SelectQueryOptions const&) @ 0x000000001b509db7 26. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50924c 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b5091fd 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b50919d 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b50915d 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b509125 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b428b1e 2024.12.16 10:55:07.223293 [ 5021 ] {e04afca6-09bd-4787-94e2-3cf2219d6c10} TCPHandler: Code: 36. DB::Exception: Wrong JSON string to merge: Invalid value.: In scope SELECT JSONMergePatch(REPEAT('{"c":', 1)). (BAD_ARGUMENTS), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, char const*&&) @ 0x000000000ece6bb3 6. /build/src/Functions/jsonMergePatch.cpp:105: DB::(anonymous namespace)::FunctionJSONMergePatch::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const::'lambda'(DB::ColumnString const&, rapidjson::GenericDocument, rapidjson::MemoryPoolAllocator, rapidjson::CrtAllocator>&, unsigned long)::operator()(DB::ColumnString const&, rapidjson::GenericDocument, rapidjson::MemoryPoolAllocator, rapidjson::CrtAllocator>&, unsigned long) const @ 0x000000000ece3058 7. /build/src/Functions/jsonMergePatch.cpp:128: DB::(anonymous namespace)::FunctionJSONMergePatch::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000ece2580 8. /build/src/Functions/IFunction.h:443: DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000a8ef299 9. /build/src/Functions/IFunctionAdaptors.h:26: DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000af6a9ad 10. /build/src/Functions/IFunction.cpp:277: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019062706 11. /build/src/Functions/IFunction.cpp:191: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019062283 12. /build/src/Functions/IFunction.cpp:269: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x00000000190625e3 13. /build/src/Functions/IFunction.cpp:336: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019063826 14. /build/src/Functions/IFunction.cpp:411: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x00000000190648b5 15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6185: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bdb89 16. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a24ea 17. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a0a21 18. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0ab1c7 19. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09cd43 20. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001b09af74 21. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr&, std::shared_ptr) @ 0x000000001b09ac33 22. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr) @ 0x000000001b08c3a6 23. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr const&, DB::SelectQueryOptions const&, std::shared_ptr const&, std::shared_ptr const&) @ 0x000000001b507dac 24. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x000000001b5069e6 25. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr const&, DB::SelectQueryOptions const&) @ 0x000000001b509db7 26. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50924c 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b5091fd 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b50919d 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b50915d 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b509125 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b428b1e 2024.12.16 10:55:08.474458 [ 3549 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::TextLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:296: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd2e93 21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set, std::equal_to, std::allocator>&) @ 0x000000001ccd371a 22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf3803a 23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d (version 24.3.12.76.altinitystable) 2024.12.16 10:55:08.832709 [ 5023 ] {132cb10a-b3c9-4421-925a-1b8d2b588384} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=862, jobs=796). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:55292) (comment: 00862_decimal_in.sql) (in query: SELECT * FROM temp WHERE x IN (toDecimal128(128, 2));), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133dc4ad 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d4458 8. /build/src/Common/ThreadPool.cpp:338: ThreadPoolImpl::scheduleOrThrow(std::function, Priority, unsigned long, bool) @ 0x00000000133d4d10 9. /build/src/Common/ThreadPool.h:205: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001d538cf3 10. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:112: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long) @ 0x000000001d538a34 11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:138: DB::PullingAsyncPipelineExecutor::pull(DB::Block&, unsigned long) @ 0x000000001d538de9 12. /build/src/Server/TCPHandler.cpp:1023: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d47ad7f 13. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d47005b 14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 20. ? @ 0x00007f713a222ac3 21. ? @ 0x00007f713a2b4850 2024.12.16 10:55:08.859671 [ 5023 ] {132cb10a-b3c9-4421-925a-1b8d2b588384} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=862, jobs=796). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133dc4ad 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d4458 8. /build/src/Common/ThreadPool.cpp:338: ThreadPoolImpl::scheduleOrThrow(std::function, Priority, unsigned long, bool) @ 0x00000000133d4d10 9. /build/src/Common/ThreadPool.h:205: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001d538cf3 10. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:112: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long) @ 0x000000001d538a34 11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:138: DB::PullingAsyncPipelineExecutor::pull(DB::Block&, unsigned long) @ 0x000000001d538de9 12. /build/src/Server/TCPHandler.cpp:1023: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d47ad7f 13. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d47005b 14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 20. ? @ 0x00007f713a222ac3 21. ? @ 0x00007f713a2b4850 2024.12.16 10:55:12.672984 [ 3552 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:298: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd2eaf 21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set, std::equal_to, std::allocator>&) @ 0x000000001ccd371a 22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf3803a 23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d (version 24.3.12.76.altinitystable) 2024.12.16 10:55:13.493694 [ 5023 ] {ebb1e991-49e6-4e12-a0cc-54e37c388f56} executeQuery: Code: 701. DB::Exception: Reading in parallel from replicas is enabled but cluster to execute query is not provided. Please set 'cluster_for_parallel_replicas' setting. (CLUSTER_DOESNT_EXIST) (version 24.3.12.76.altinitystable) (from [::1]:60230) (comment: 03215_analyzer_replace_with_dummy_tables.sql) (in query: SELECT 1 FROM ( SELECT number IN ( SELECT number FROM view( SELECT number FROM numbers(1) ) ) FROM t ) SETTINGS allow_experimental_parallel_reading_from_replicas = 1, max_parallel_replicas = 2, allow_experimental_analyzer = 1;), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f4eb7 6. /build/src/Interpreters/ClusterProxy/executeQuery.cpp:377: DB::ClusterProxy::executeQueryWithParallelReplicas(DB::QueryPlan&, DB::ClusterProxy::SelectStreamFactory&, std::shared_ptr const&, std::shared_ptr, std::shared_ptr> const>) @ 0x000000001bd5f475 7. /build/src/Planner/findParallelReplicasQuery.cpp:423: DB::buildQueryPlanForParallelReplicas(DB::QueryNode const&, std::shared_ptr const&, std::shared_ptr> const>) @ 0x000000001b542f5c 8. /build/src/Planner/Planner.cpp:1468: DB::Planner::buildPlanForQueryNode() @ 0x000000001b50f459 9. /build/src/Planner/Planner.cpp:0: DB::Planner::buildQueryPlanIfNeeded() @ 0x000000001b50b655 10. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:234: DB::InterpreterSelectQueryAnalyzer::getQueryPlan() @ 0x000000001b50885d 11. /build/src/Interpreters/executeQuery.cpp:1146: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb2012 12. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 13. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 20. ? @ 0x00007f713a222ac3 21. ? @ 0x00007f713a2b4850 2024.12.16 10:55:13.522529 [ 5023 ] {ebb1e991-49e6-4e12-a0cc-54e37c388f56} TCPHandler: Code: 701. DB::Exception: Reading in parallel from replicas is enabled but cluster to execute query is not provided. Please set 'cluster_for_parallel_replicas' setting. (CLUSTER_DOESNT_EXIST), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f4eb7 6. /build/src/Interpreters/ClusterProxy/executeQuery.cpp:377: DB::ClusterProxy::executeQueryWithParallelReplicas(DB::QueryPlan&, DB::ClusterProxy::SelectStreamFactory&, std::shared_ptr const&, std::shared_ptr, std::shared_ptr> const>) @ 0x000000001bd5f475 7. /build/src/Planner/findParallelReplicasQuery.cpp:423: DB::buildQueryPlanForParallelReplicas(DB::QueryNode const&, std::shared_ptr const&, std::shared_ptr> const>) @ 0x000000001b542f5c 8. /build/src/Planner/Planner.cpp:1468: DB::Planner::buildPlanForQueryNode() @ 0x000000001b50f459 9. /build/src/Planner/Planner.cpp:0: DB::Planner::buildQueryPlanIfNeeded() @ 0x000000001b50b655 10. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:234: DB::InterpreterSelectQueryAnalyzer::getQueryPlan() @ 0x000000001b50885d 11. /build/src/Interpreters/executeQuery.cpp:1146: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb2012 12. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 13. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 20. ? @ 0x00007f713a222ac3 21. ? @ 0x00007f713a2b4850 2024.12.16 10:55:16.986805 [ 4401 ] {0da4c01e-606f-473a-b0b1-894c1f8ca3bc} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=21, jobs=1). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:60272) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM system.processes WHERE query_id != queryID() AND current_database = currentDatabase() AND query LIKE '%-- 11317_tuple%'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:55:17.157430 [ 4401 ] {0da4c01e-606f-473a-b0b1-894c1f8ca3bc} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=21, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:55:18.606911 [ 3591 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::BlobStorageLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:147: DB::IMergeTreeDataPart::MinMaxIndex::store(std::vector> const&, std::vector, std::allocator>> const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caad019 21. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:118: DB::IMergeTreeDataPart::MinMaxIndex::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caab9fb 22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:244: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39ccf 23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 26. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 (version 24.3.12.76.altinitystable) 2024.12.16 10:55:20.020966 [ 4182 ] {bfca0681-811d-47e0-9055-e990d25ba50f} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=53, jobs=53). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:60292) (comment: 03215_udf_with_union.sql) (in query: SELECT 03215_udf_with_union();), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:55:20.042899 [ 4182 ] {bfca0681-811d-47e0-9055-e990d25ba50f} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=53, jobs=53). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:55:22.277849 [ 5021 ] {02e866cb-b19d-48ce-8e95-266d4e08bdf0} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=2, jobs=2). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:55998) (comment: 02427_msan_group_array_resample.sql) (in query: SELECT arrayMap(x -> finalizeAggregation(x), state) FROM (SELECT groupArrayResample(9223372036854775806, 1048575, 65537)(number, number % 3), groupArrayStateResample(10, 2147483648, 65535)(number, number % 9223372036854775806) AS state FROM numbers(100));), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:55:22.394530 [ 5021 ] {02e866cb-b19d-48ce-8e95-266d4e08bdf0} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=2, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:55:24.754046 [ 5021 ] {9b15fbd1-204c-416b-81eb-d44bfb0d2eab} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=13, jobs=13). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:56004) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM system.processes WHERE query_id != queryID() AND current_database = currentDatabase() AND query LIKE '%-- 11317_tuple%'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:55:24.898418 [ 5021 ] {9b15fbd1-204c-416b-81eb-d44bfb0d2eab} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=13, jobs=13). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:55:25.126928 [ 3547 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::TransactionsInfoLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:286: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf3a6fb 21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 (version 24.3.12.76.altinitystable) 2024.12.16 10:55:26.671583 [ 4401 ] {db52d9a2-d2aa-408e-b64b-ea229386ac55} executeQuery: Code: 44. DB::Exception: Cannot create column with type 'Variant(String, UInt32)' because experimental Variant type is not allowed. Set setting allow_experimental_variant_type = 1 in order to allow it. (ILLEGAL_COLUMN) (version 24.3.12.76.altinitystable) (from [::1]:56010) (comment: 03215_validate_type_in_alter_add_modify_column.sql) (in query: alter table test add column bad Variant(UInt32, String);), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000a8efdf3 6. /build/src/Interpreters/parseColumnsListForTableFunction.cpp:71: DB::validateDataType(std::shared_ptr const&, DB::DataTypeValidationSettings const&)::$_0::operator()(DB::IDataType const&) const @ 0x000000001bc0e16c 7. /build/src/Interpreters/parseColumnsListForTableFunction.cpp:109: DB::validateDataType(std::shared_ptr const&, DB::DataTypeValidationSettings const&) @ 0x000000001bc0db8d 8. /build/src/Storages/AlterCommands.cpp:1290: DB::AlterCommands::validate(std::shared_ptr const&, std::shared_ptr) const @ 0x000000001c24fe80 9. /build/src/Interpreters/InterpreterAlterQuery.cpp:198: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001affa152 10. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff7cde 11. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 12. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 13. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 20. ? @ 0x00007f713a222ac3 21. ? @ 0x00007f713a2b4850 2024.12.16 10:55:26.675901 [ 4401 ] {db52d9a2-d2aa-408e-b64b-ea229386ac55} TCPHandler: Code: 44. DB::Exception: Cannot create column with type 'Variant(String, UInt32)' because experimental Variant type is not allowed. Set setting allow_experimental_variant_type = 1 in order to allow it. (ILLEGAL_COLUMN), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000a8efdf3 6. /build/src/Interpreters/parseColumnsListForTableFunction.cpp:71: DB::validateDataType(std::shared_ptr const&, DB::DataTypeValidationSettings const&)::$_0::operator()(DB::IDataType const&) const @ 0x000000001bc0e16c 7. /build/src/Interpreters/parseColumnsListForTableFunction.cpp:109: DB::validateDataType(std::shared_ptr const&, DB::DataTypeValidationSettings const&) @ 0x000000001bc0db8d 8. /build/src/Storages/AlterCommands.cpp:1290: DB::AlterCommands::validate(std::shared_ptr const&, std::shared_ptr) const @ 0x000000001c24fe80 9. /build/src/Interpreters/InterpreterAlterQuery.cpp:198: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001affa152 10. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff7cde 11. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 12. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 13. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 20. ? @ 0x00007f713a222ac3 21. ? @ 0x00007f713a2b4850 2024.12.16 10:55:27.137811 [ 4401 ] {f3f8a244-7b0e-4264-a61f-52adb7690b39} executeQuery: Code: 455. DB::Exception: Creating columns of type LowCardinality(UInt8) is prohibited by default due to expected negative impact on performance. It can be enabled with the "allow_suspicious_low_cardinality_types" setting. (SUSPICIOUS_TYPE_FOR_LOW_CARDINALITY) (version 24.3.12.76.altinitystable) (from [::1]:56010) (comment: 03215_validate_type_in_alter_add_modify_column.sql) (in query: alter table test add column bad LowCardinality(UInt8);), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000a8efdf3 6. /build/src/Interpreters/parseColumnsListForTableFunction.cpp:33: DB::validateDataType(std::shared_ptr const&, DB::DataTypeValidationSettings const&)::$_0::operator()(DB::IDataType const&) const @ 0x000000001bc0dd4d 7. /build/src/Interpreters/parseColumnsListForTableFunction.cpp:109: DB::validateDataType(std::shared_ptr const&, DB::DataTypeValidationSettings const&) @ 0x000000001bc0db8d 8. /build/src/Storages/AlterCommands.cpp:1290: DB::AlterCommands::validate(std::shared_ptr const&, std::shared_ptr) const @ 0x000000001c24fe80 9. /build/src/Interpreters/InterpreterAlterQuery.cpp:198: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001affa152 10. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff7cde 11. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 12. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 13. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 20. ? @ 0x00007f713a222ac3 21. ? @ 0x00007f713a2b4850 2024.12.16 10:55:27.180958 [ 4401 ] {f3f8a244-7b0e-4264-a61f-52adb7690b39} TCPHandler: Code: 455. DB::Exception: Creating columns of type LowCardinality(UInt8) is prohibited by default due to expected negative impact on performance. It can be enabled with the "allow_suspicious_low_cardinality_types" setting. (SUSPICIOUS_TYPE_FOR_LOW_CARDINALITY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000a8efdf3 6. /build/src/Interpreters/parseColumnsListForTableFunction.cpp:33: DB::validateDataType(std::shared_ptr const&, DB::DataTypeValidationSettings const&)::$_0::operator()(DB::IDataType const&) const @ 0x000000001bc0dd4d 7. /build/src/Interpreters/parseColumnsListForTableFunction.cpp:109: DB::validateDataType(std::shared_ptr const&, DB::DataTypeValidationSettings const&) @ 0x000000001bc0db8d 8. /build/src/Storages/AlterCommands.cpp:1290: DB::AlterCommands::validate(std::shared_ptr const&, std::shared_ptr) const @ 0x000000001c24fe80 9. /build/src/Interpreters/InterpreterAlterQuery.cpp:198: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001affa152 10. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff7cde 11. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 12. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 13. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 20. ? @ 0x00007f713a222ac3 21. ? @ 0x00007f713a2b4850 2024.12.16 10:55:27.594225 [ 4401 ] {d77dfb9e-27c4-444b-b02b-e4caaf5ff573} executeQuery: Code: 44. DB::Exception: Cannot create column with type 'FixedString(10000)' because fixed string with size > 256 is suspicious. Set setting allow_suspicious_fixed_string_types = 1 in order to allow it. (ILLEGAL_COLUMN) (version 24.3.12.76.altinitystable) (from [::1]:56010) (comment: 03215_validate_type_in_alter_add_modify_column.sql) (in query: alter table test add column bad FixedString(10000);), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, int&&) @ 0x000000001bc0f82c 6. /build/src/Interpreters/parseColumnsListForTableFunction.cpp:58: DB::validateDataType(std::shared_ptr const&, DB::DataTypeValidationSettings const&)::$_0::operator()(DB::IDataType const&) const @ 0x000000001bc0e01d 7. /build/src/Interpreters/parseColumnsListForTableFunction.cpp:109: DB::validateDataType(std::shared_ptr const&, DB::DataTypeValidationSettings const&) @ 0x000000001bc0db8d 8. /build/src/Storages/AlterCommands.cpp:1290: DB::AlterCommands::validate(std::shared_ptr const&, std::shared_ptr) const @ 0x000000001c24fe80 9. /build/src/Interpreters/InterpreterAlterQuery.cpp:198: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001affa152 10. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff7cde 11. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 12. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 13. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 20. ? @ 0x00007f713a222ac3 21. ? @ 0x00007f713a2b4850 2024.12.16 10:55:27.614998 [ 4401 ] {d77dfb9e-27c4-444b-b02b-e4caaf5ff573} TCPHandler: Code: 44. DB::Exception: Cannot create column with type 'FixedString(10000)' because fixed string with size > 256 is suspicious. Set setting allow_suspicious_fixed_string_types = 1 in order to allow it. (ILLEGAL_COLUMN), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, int&&) @ 0x000000001bc0f82c 6. /build/src/Interpreters/parseColumnsListForTableFunction.cpp:58: DB::validateDataType(std::shared_ptr const&, DB::DataTypeValidationSettings const&)::$_0::operator()(DB::IDataType const&) const @ 0x000000001bc0e01d 7. /build/src/Interpreters/parseColumnsListForTableFunction.cpp:109: DB::validateDataType(std::shared_ptr const&, DB::DataTypeValidationSettings const&) @ 0x000000001bc0db8d 8. /build/src/Storages/AlterCommands.cpp:1290: DB::AlterCommands::validate(std::shared_ptr const&, std::shared_ptr) const @ 0x000000001c24fe80 9. /build/src/Interpreters/InterpreterAlterQuery.cpp:198: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001affa152 10. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff7cde 11. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 12. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 13. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 20. ? @ 0x00007f713a222ac3 21. ? @ 0x00007f713a2b4850 2024.12.16 10:55:28.065786 [ 4401 ] {6eeb2acb-174f-4fc3-a088-3e56efe4d4a9} executeQuery: Code: 44. DB::Exception: Cannot create column with type 'Variant(String, UInt32)' because experimental Variant type is not allowed. Set setting allow_experimental_variant_type = 1 in order to allow it. (ILLEGAL_COLUMN) (version 24.3.12.76.altinitystable) (from [::1]:56010) (comment: 03215_validate_type_in_alter_add_modify_column.sql) (in query: alter table test modify column id Variant(UInt32, String);), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000a8efdf3 6. /build/src/Interpreters/parseColumnsListForTableFunction.cpp:71: DB::validateDataType(std::shared_ptr const&, DB::DataTypeValidationSettings const&)::$_0::operator()(DB::IDataType const&) const @ 0x000000001bc0e16c 7. /build/src/Interpreters/parseColumnsListForTableFunction.cpp:109: DB::validateDataType(std::shared_ptr const&, DB::DataTypeValidationSettings const&) @ 0x000000001bc0db8d 8. /build/src/Storages/AlterCommands.cpp:1372: DB::AlterCommands::validate(std::shared_ptr const&, std::shared_ptr) const @ 0x000000001c251347 9. /build/src/Interpreters/InterpreterAlterQuery.cpp:198: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001affa152 10. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff7cde 11. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 12. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 13. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 20. ? @ 0x00007f713a222ac3 21. ? @ 0x00007f713a2b4850 2024.12.16 10:55:28.078848 [ 4401 ] {6eeb2acb-174f-4fc3-a088-3e56efe4d4a9} TCPHandler: Code: 44. DB::Exception: Cannot create column with type 'Variant(String, UInt32)' because experimental Variant type is not allowed. Set setting allow_experimental_variant_type = 1 in order to allow it. (ILLEGAL_COLUMN), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000a8efdf3 6. /build/src/Interpreters/parseColumnsListForTableFunction.cpp:71: DB::validateDataType(std::shared_ptr const&, DB::DataTypeValidationSettings const&)::$_0::operator()(DB::IDataType const&) const @ 0x000000001bc0e16c 7. /build/src/Interpreters/parseColumnsListForTableFunction.cpp:109: DB::validateDataType(std::shared_ptr const&, DB::DataTypeValidationSettings const&) @ 0x000000001bc0db8d 8. /build/src/Storages/AlterCommands.cpp:1372: DB::AlterCommands::validate(std::shared_ptr const&, std::shared_ptr) const @ 0x000000001c251347 9. /build/src/Interpreters/InterpreterAlterQuery.cpp:198: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001affa152 10. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff7cde 11. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 12. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 13. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 20. ? @ 0x00007f713a222ac3 21. ? @ 0x00007f713a2b4850 2024.12.16 10:55:28.446979 [ 4401 ] {43138ab8-5341-4d3c-943f-b6844e2d6b90} executeQuery: Code: 455. DB::Exception: Creating columns of type LowCardinality(UInt8) is prohibited by default due to expected negative impact on performance. It can be enabled with the "allow_suspicious_low_cardinality_types" setting. (SUSPICIOUS_TYPE_FOR_LOW_CARDINALITY) (version 24.3.12.76.altinitystable) (from [::1]:56010) (comment: 03215_validate_type_in_alter_add_modify_column.sql) (in query: alter table test modify column id LowCardinality(UInt8);), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000a8efdf3 6. /build/src/Interpreters/parseColumnsListForTableFunction.cpp:33: DB::validateDataType(std::shared_ptr const&, DB::DataTypeValidationSettings const&)::$_0::operator()(DB::IDataType const&) const @ 0x000000001bc0dd4d 7. /build/src/Interpreters/parseColumnsListForTableFunction.cpp:109: DB::validateDataType(std::shared_ptr const&, DB::DataTypeValidationSettings const&) @ 0x000000001bc0db8d 8. /build/src/Storages/AlterCommands.cpp:1372: DB::AlterCommands::validate(std::shared_ptr const&, std::shared_ptr) const @ 0x000000001c251347 9. /build/src/Interpreters/InterpreterAlterQuery.cpp:198: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001affa152 10. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff7cde 11. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 12. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 13. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 20. ? @ 0x00007f713a222ac3 21. ? @ 0x00007f713a2b4850 2024.12.16 10:55:28.451984 [ 4401 ] {43138ab8-5341-4d3c-943f-b6844e2d6b90} TCPHandler: Code: 455. DB::Exception: Creating columns of type LowCardinality(UInt8) is prohibited by default due to expected negative impact on performance. It can be enabled with the "allow_suspicious_low_cardinality_types" setting. (SUSPICIOUS_TYPE_FOR_LOW_CARDINALITY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000a8efdf3 6. /build/src/Interpreters/parseColumnsListForTableFunction.cpp:33: DB::validateDataType(std::shared_ptr const&, DB::DataTypeValidationSettings const&)::$_0::operator()(DB::IDataType const&) const @ 0x000000001bc0dd4d 7. /build/src/Interpreters/parseColumnsListForTableFunction.cpp:109: DB::validateDataType(std::shared_ptr const&, DB::DataTypeValidationSettings const&) @ 0x000000001bc0db8d 8. /build/src/Storages/AlterCommands.cpp:1372: DB::AlterCommands::validate(std::shared_ptr const&, std::shared_ptr) const @ 0x000000001c251347 9. /build/src/Interpreters/InterpreterAlterQuery.cpp:198: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001affa152 10. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff7cde 11. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 12. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 13. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 20. ? @ 0x00007f713a222ac3 21. ? @ 0x00007f713a2b4850 2024.12.16 10:55:28.890184 [ 4401 ] {79865acb-1df2-4699-9608-a87c4525e4da} executeQuery: Code: 44. DB::Exception: Cannot create column with type 'FixedString(10000)' because fixed string with size > 256 is suspicious. Set setting allow_suspicious_fixed_string_types = 1 in order to allow it. (ILLEGAL_COLUMN) (version 24.3.12.76.altinitystable) (from [::1]:56010) (comment: 03215_validate_type_in_alter_add_modify_column.sql) (in query: alter table test modify column id FixedString(10000);), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, int&&) @ 0x000000001bc0f82c 6. /build/src/Interpreters/parseColumnsListForTableFunction.cpp:58: DB::validateDataType(std::shared_ptr const&, DB::DataTypeValidationSettings const&)::$_0::operator()(DB::IDataType const&) const @ 0x000000001bc0e01d 7. /build/src/Interpreters/parseColumnsListForTableFunction.cpp:109: DB::validateDataType(std::shared_ptr const&, DB::DataTypeValidationSettings const&) @ 0x000000001bc0db8d 8. /build/src/Storages/AlterCommands.cpp:1372: DB::AlterCommands::validate(std::shared_ptr const&, std::shared_ptr) const @ 0x000000001c251347 9. /build/src/Interpreters/InterpreterAlterQuery.cpp:198: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001affa152 10. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff7cde 11. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 12. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 13. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 20. ? @ 0x00007f713a222ac3 21. ? @ 0x00007f713a2b4850 2024.12.16 10:55:28.895512 [ 4401 ] {79865acb-1df2-4699-9608-a87c4525e4da} TCPHandler: Code: 44. DB::Exception: Cannot create column with type 'FixedString(10000)' because fixed string with size > 256 is suspicious. Set setting allow_suspicious_fixed_string_types = 1 in order to allow it. (ILLEGAL_COLUMN), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, int&&) @ 0x000000001bc0f82c 6. /build/src/Interpreters/parseColumnsListForTableFunction.cpp:58: DB::validateDataType(std::shared_ptr const&, DB::DataTypeValidationSettings const&)::$_0::operator()(DB::IDataType const&) const @ 0x000000001bc0e01d 7. /build/src/Interpreters/parseColumnsListForTableFunction.cpp:109: DB::validateDataType(std::shared_ptr const&, DB::DataTypeValidationSettings const&) @ 0x000000001bc0db8d 8. /build/src/Storages/AlterCommands.cpp:1372: DB::AlterCommands::validate(std::shared_ptr const&, std::shared_ptr) const @ 0x000000001c251347 9. /build/src/Interpreters/InterpreterAlterQuery.cpp:198: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001affa152 10. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff7cde 11. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 12. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 13. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 20. ? @ 0x00007f713a222ac3 21. ? @ 0x00007f713a2b4850 2024.12.16 10:55:32.609679 [ 3751 ] {5eabe09c-886b-47fe-9751-106d0b6f7ac3} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=9, jobs=9). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:53650) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM system.processes WHERE query_id != queryID() AND current_database = currentDatabase() AND query LIKE '%-- 11317_tuple%'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:55:32.709717 [ 3751 ] {5eabe09c-886b-47fe-9751-106d0b6f7ac3} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=9, jobs=9). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:55:35.846339 [ 3591 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::BlobStorageLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:323: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf3ae44 21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 (version 24.3.12.76.altinitystable) 2024.12.16 10:55:37.714348 [ 3751 ] {a8b63fdc-6fee-46a8-9d48-9d7e1cf0a797} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:53672) (comment: 03210_variant_with_aggregate_function_type.sql) (in query: INSERT INTO test_agg_variant SELECT Name, t AS Value FROM ( SELECT Name, arrayJoin([ uniqExactState(Value)::Variant(AggregateFunction(uniqExact, Int64), AggregateFunction(avg, Int64)), avgState(Value)::Variant(AggregateFunction(uniqExact, Int64), AggregateFunction(avg, Int64)) ]) AS t FROM source GROUP BY Name );), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:49: DB::threadFunction(DB::CompletedPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d512d1d 13. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:90: DB::CompletedPipelineExecutor::execute()::$_0::operator()() const @ 0x000000001d512baa 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d512b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::CompletedPipelineExecutor::execute()::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d512b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::CompletedPipelineExecutor::execute()::$_0&, std::tuple<>&) @ 0x000000001d512a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'()::operator()() @ 0x000000001d5129a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d512915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5128f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5128d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5128a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:55:37.757539 [ 3751 ] {a8b63fdc-6fee-46a8-9d48-9d7e1cf0a797} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:49: DB::threadFunction(DB::CompletedPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d512d1d 13. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:90: DB::CompletedPipelineExecutor::execute()::$_0::operator()() const @ 0x000000001d512baa 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d512b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::CompletedPipelineExecutor::execute()::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d512b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::CompletedPipelineExecutor::execute()::$_0&, std::tuple<>&) @ 0x000000001d512a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'()::operator()() @ 0x000000001d5129a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d512915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5128f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5128d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5128a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:55:38.362949 [ 4401 ] {706f36d4-b7ef-40ef-922d-e4529780eb81} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=20, jobs=20). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:53690) (comment: 02661_read_from_archive_tzst.sh) (in query: SELECT * FROM file('/var/lib/clickhouse/user_files/02661_read_from_archive_test_lwsljr0k_tzst_archive3.tzst :: 02661_read_from_archive_test_lwsljr0k_tzst_data*.csv') ORDER BY 1, 2), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:55:38.496531 [ 4401 ] {706f36d4-b7ef-40ef-922d-e4529780eb81} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=20, jobs=20). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:55:39.382360 [ 3868 ] {1163684a-814c-4fae-b248-29da504f5465} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=4, jobs=4): while pushing to view test_1.wv (a2de7aa9-7124-4016-995e-d12992706b6f). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:53664) (comment: 01083_window_view_select.sh) (in query: INSERT INTO mt VALUES ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Storages/WindowView/StorageWindowView.cpp:1587: DB::StorageWindowView::writeIntoWindowView(DB::StorageWindowView&, DB::Block const&, std::shared_ptr) @ 0x000000001d176224 13. /build/src/Processors/Transforms/buildPushingToViewsChain.cpp:798: DB::PushingToWindowViewSink::consume(DB::Chunk) @ 0x000000001db71d20 14. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 15. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 22. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:114: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x000000001da4145a 23. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work() @ 0x000000001da40e9e 24. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 25. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 26. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 27. /build/src/Processors/Executors/PipelineExecutor.cpp:148: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x000000001d51599e 28. /build/src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000001d541b5e 29. /build/src/Server/TCPHandler.cpp:920: auto DB::TCPHandler::processInsertQuery()::$_0::operator()(DB::PushingPipelineExecutor&, DB::Block) const @ 0x000000001d47db1e 30. /build/src/Server/TCPHandler.cpp:987: DB::TCPHandler::processInsertQuery() @ 0x000000001d47aa2a 31. /build/src/Server/TCPHandler.cpp:534: DB::TCPHandler::runImpl() @ 0x000000001d46ff31 2024.12.16 10:55:39.454620 [ 3868 ] {1163684a-814c-4fae-b248-29da504f5465} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=4, jobs=4): while pushing to view test_1.wv (a2de7aa9-7124-4016-995e-d12992706b6f). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Storages/WindowView/StorageWindowView.cpp:1587: DB::StorageWindowView::writeIntoWindowView(DB::StorageWindowView&, DB::Block const&, std::shared_ptr) @ 0x000000001d176224 13. /build/src/Processors/Transforms/buildPushingToViewsChain.cpp:798: DB::PushingToWindowViewSink::consume(DB::Chunk) @ 0x000000001db71d20 14. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 15. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 22. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:114: DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x000000001da4145a 23. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work() @ 0x000000001da40e9e 24. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 25. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 26. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 27. /build/src/Processors/Executors/PipelineExecutor.cpp:148: DB::PipelineExecutor::executeStep(std::atomic*) @ 0x000000001d51599e 28. /build/src/Processors/Executors/PushingPipelineExecutor.cpp:123: DB::PushingPipelineExecutor::finish() @ 0x000000001d541b5e 29. /build/src/Server/TCPHandler.cpp:920: auto DB::TCPHandler::processInsertQuery()::$_0::operator()(DB::PushingPipelineExecutor&, DB::Block) const @ 0x000000001d47db1e 30. /build/src/Server/TCPHandler.cpp:987: DB::TCPHandler::processInsertQuery() @ 0x000000001d47aa2a 31. /build/src/Server/TCPHandler.cpp:534: DB::TCPHandler::runImpl() @ 0x000000001d46ff31 2024.12.16 10:55:40.788868 [ 5021 ] {10a6317a-62df-4507-b034-d318ee0c9fb2} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=4, jobs=4). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:51388) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM system.processes WHERE query_id != queryID() AND current_database = currentDatabase() AND query LIKE '%-- 11317_tuple%'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:55:40.871340 [ 5021 ] {10a6317a-62df-4507-b034-d318ee0c9fb2} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=4, jobs=4). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:55:43.911681 [ 5021 ] {22fcd28f-9660-43a1-a0ab-0ad83ff01bf4} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=5). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:51408) (comment: 01083_window_view_select.sh) (in query: SELECT count(*) FROM wv), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:55:43.946616 [ 5021 ] {22fcd28f-9660-43a1-a0ab-0ad83ff01bf4} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=5). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:55:48.528986 [ 3868 ] {b7a7477b-910f-44ee-96e3-c811202a48a5} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=13, jobs=13). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:51456) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM system.processes WHERE query_id != queryID() AND current_database = currentDatabase() AND query LIKE '%-- 11317_tuple%'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:55:48.638445 [ 3868 ] {b7a7477b-910f-44ee-96e3-c811202a48a5} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=13, jobs=13). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:55:53.379135 [ 4401 ] {7f05ecd7-2a94-426f-b5cf-7be9c200be5a} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=8, jobs=8). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:52132) (comment: 02661_read_from_archive_tzst.sh) (in query: SELECT * FROM 02661_archive_table ORDER BY 1, 2), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:55:53.473761 [ 3549 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::TextLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:286: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf3a6fb 21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 (version 24.3.12.76.altinitystable) 2024.12.16 10:55:53.551601 [ 4401 ] {7f05ecd7-2a94-426f-b5cf-7be9c200be5a} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=8, jobs=8). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:55:56.757158 [ 4402 ] {97470de7-4481-4a02-9465-929ef21b25e6} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=20, jobs=20). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:52156) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM system.processes WHERE query_id != queryID() AND current_database = currentDatabase() AND query LIKE '%-- 11317_tuple%'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:55:56.852052 [ 4402 ] {97470de7-4481-4a02-9465-929ef21b25e6} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=20, jobs=20). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:55:59.446335 [ 4402 ] {49ae1738-f393-4d1b-8994-21d7d87b0417} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=23, jobs=23). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:46350) (comment: 01083_window_view_select.sh) (in query: SELECT count(*) FROM wv), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:55:59.554543 [ 4402 ] {49ae1738-f393-4d1b-8994-21d7d87b0417} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=23, jobs=23). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:55:59.954269 [ 3549 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::TextLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:260: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf3a0a0 21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 (version 24.3.12.76.altinitystable) 2024.12.16 10:56:02.050436 [ 3751 ] {a9cf7a33-6ea8-4b16-9ea7-8634fb9ea122} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=3, jobs=3). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:52104) (comment: 03209_parameterized_view_with_non_literal_params.sql) (in query: select id from date32_pv(dtparam='2199-12-31');), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:56:02.108748 [ 3751 ] {a9cf7a33-6ea8-4b16-9ea7-8634fb9ea122} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=3, jobs=3). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:56:04.909055 [ 3751 ] {7bc9abbf-6023-4b6e-9dc9-74862aea947b} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=41, jobs=41). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:46374) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM system.processes WHERE query_id != queryID() AND current_database = currentDatabase() AND query LIKE '%-- 11317_tuple%'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:56:05.029084 [ 3751 ] {7bc9abbf-6023-4b6e-9dc9-74862aea947b} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=41, jobs=41). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:56:07.372583 [ 3490 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {41d82839-5472-4425-b891-a2dc2a236577::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=30, jobs=3). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1fc91 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1fb3b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1faf0 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1fab0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1fa3b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce216d1 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1f750 16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future> DB::scheduleFromThreadPoolUnsafe, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl>&, String const&, Priority) @ 0x000000001ce1f09c 17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1d6c3 18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl>*, unsigned long) @ 0x000000001ce1d5b3 19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6eeac 20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, void, void>(std::allocator&, DB::MergeTreeMarksLoader*, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6edb5 21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int>(std::allocator, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6ece3 22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], std::shared_ptr&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, void>(std::allocator const&, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6eb95 23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, void>(std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6e49b 24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&, std::function const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bed3 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bbdd 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bb9d 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bb5d 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bb28 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd6a7e 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd2efd 31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fd02d6 (version 24.3.12.76.altinitystable) 2024.12.16 10:56:08.043125 [ 3552 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:296: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd2e93 21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set, std::equal_to, std::allocator>&) @ 0x000000001ccd371a 22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf3803a 23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d (version 24.3.12.76.altinitystable) 2024.12.16 10:56:09.515316 [ 4182 ] {18501cb3-aeb5-4b69-8fde-3765f724be5a} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=0). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:46418) (comment: 03205_parallel_window_finctions_and_column_sparse_bug.sql) (in query: insert into t values ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:294: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf3a8b6 21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 2024.12.16 10:56:09.521548 [ 4182 ] {18501cb3-aeb5-4b69-8fde-3765f724be5a} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:294: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf3a8b6 21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 2024.12.16 10:56:09.838068 [ 5021 ] {ac50b899-fe1a-4f53-92fe-a71055c6e37b} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=4, jobs=4). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:42744) (comment: 01083_window_view_select.sh) (in query: SELECT count(*) FROM wv), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:56:09.872200 [ 5021 ] {ac50b899-fe1a-4f53-92fe-a71055c6e37b} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=4, jobs=4). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:56:10.061254 [ 3484 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {41d82839-5472-4425-b891-a2dc2a236577::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=30, jobs=6). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1fc91 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1fb3b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1faf0 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1fab0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1fa3b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce216d1 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1f750 16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future> DB::scheduleFromThreadPoolUnsafe, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl>&, String const&, Priority) @ 0x000000001ce1f09c 17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1d6c3 18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl>*, unsigned long) @ 0x000000001ce1d5b3 19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6eeac 20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, void, void>(std::allocator&, DB::MergeTreeMarksLoader*, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6edb5 21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int>(std::allocator, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6ece3 22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], std::shared_ptr&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, void>(std::allocator const&, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6eb95 23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, void>(std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6e49b 24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&, std::function const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bed3 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bbdd 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bb9d 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bb5d 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bb28 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd6a7e 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd2efd 31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fd02d6 (version 24.3.12.76.altinitystable) 2024.12.16 10:56:12.851358 [ 3485 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {41d82839-5472-4425-b891-a2dc2a236577::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=31, jobs=6). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1fc91 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1fb3b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1faf0 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1fab0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1fa3b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce216d1 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1f750 16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future> DB::scheduleFromThreadPoolUnsafe, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl>&, String const&, Priority) @ 0x000000001ce1f09c 17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1d6c3 18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl>*, unsigned long) @ 0x000000001ce1d5b3 19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6eeac 20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, void, void>(std::allocator&, DB::MergeTreeMarksLoader*, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6edb5 21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int>(std::allocator, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6ece3 22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], std::shared_ptr&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, void>(std::allocator const&, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6eb95 23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, void>(std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6e49b 24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&, std::function const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bed3 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bbdd 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bb9d 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bb5d 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bb28 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd6a7e 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd2efd 31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fd02d6 (version 24.3.12.76.altinitystable) 2024.12.16 10:56:15.793048 [ 3552 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:296: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd2e93 21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set, std::equal_to, std::allocator>&) @ 0x000000001ccd371a 22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf3803a 23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d (version 24.3.12.76.altinitystable) 2024.12.16 10:56:16.647268 [ 3553 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:274: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf3a3c4 21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 (version 24.3.12.76.altinitystable) 2024.12.16 10:56:22.002547 [ 3551 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::ProcessorProfileLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:147: DB::IMergeTreeDataPart::MinMaxIndex::store(std::vector> const&, std::vector, std::allocator>> const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caad019 21. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:118: DB::IMergeTreeDataPart::MinMaxIndex::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caab9fb 22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:244: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39ccf 23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 26. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 (version 24.3.12.76.altinitystable) 2024.12.16 10:56:22.335152 [ 4401 ] {8b95fead-1054-416f-a40e-1c77b61e6c8d} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=13, jobs=13). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:39498) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM system.processes WHERE query_id != queryID() AND current_database = currentDatabase() AND query LIKE '%-- 11317_tuple%'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:56:22.482909 [ 4401 ] {8b95fead-1054-416f-a40e-1c77b61e6c8d} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=13, jobs=13). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:56:23.792020 [ 3751 ] {f532e0b1-d13f-4b52-8a5a-f8a49bb058f7} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=16, jobs=16). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:46414) (comment: 00065_loyalty_with_storage_join.sql) (in query: SELECT loyalty, count() FROM hits SEMI LEFT JOIN join USING UserID GROUP BY loyalty ORDER BY loyalty ASC;), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:56:24.418321 [ 3751 ] {f532e0b1-d13f-4b52-8a5a-f8a49bb058f7} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=16, jobs=16). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:56:25.960849 [ 3751 ] {6e814b4d-95a9-492c-9702-f9552e7d00c7} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=3, jobs=3). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:39532) (comment: 01083_window_view_select.sh) (in query: SELECT count(*) FROM wv), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:56:25.987234 [ 3751 ] {6e814b4d-95a9-492c-9702-f9552e7d00c7} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=3, jobs=3). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:56:26.156691 [ 3868 ] {01f5620c-d561-4a04-be05-08f4e76aea4f} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=5, jobs=1). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:39522) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM system.processes WHERE query_id != queryID() AND current_database = currentDatabase() AND query LIKE '%-- 11317_tuple%'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:56:26.287088 [ 3868 ] {01f5620c-d561-4a04-be05-08f4e76aea4f} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=5, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:56:27.030942 [ 3488 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {bdb3abf1-bb86-44b8-a138-7f8c6b07475d::202412_1_26_5}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:298: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd2eaf 21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set, std::equal_to, std::allocator>&) @ 0x000000001ccd371a 22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf3803a 23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37f43 24. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb722bf 25. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb725d8 26. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb71fb2 27. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13ef38 28. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x000000001cba15ed 29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x000000001cba210e 30. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef, StrongTypedef, std::basic_string_view>)::'lambda'()::operator()() const @ 0x000000001cba9c78 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba9c55 (version 24.3.12.76.altinitystable) 2024.12.16 10:56:31.405034 [ 4182 ] {690055fa-c9c8-40f5-a1c4-4da2ec146751} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=9, jobs=9). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:48850) (comment: 01083_window_view_select.sh) (in query: SELECT count(*) FROM wv), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:56:31.435598 [ 4182 ] {690055fa-c9c8-40f5-a1c4-4da2ec146751} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=9, jobs=9). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:56:31.911827 [ 3565 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:260: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf3a0a0 21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 (version 24.3.12.76.altinitystable) 2024.12.16 10:56:34.417803 [ 3751 ] {f89f6d56-8f2c-4b09-b0d3-15a08c28452c} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=26). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:48872) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM system.processes WHERE query_id != queryID() AND current_database = currentDatabase() AND query LIKE '%-- 11317_tuple%'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:56:34.510081 [ 3751 ] {f89f6d56-8f2c-4b09-b0d3-15a08c28452c} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=26). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:56:36.676593 [ 4182 ] {bea24bf2-886f-4e41-9fe1-7197aed3390e} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=11, jobs=11). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:48898) (comment: 01083_window_view_select.sh) (in query: SELECT count(*) FROM wv), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:56:36.705815 [ 4182 ] {bea24bf2-886f-4e41-9fe1-7197aed3390e} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=11, jobs=11). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:56:39.096128 [ 3551 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::ProcessorProfileLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:298: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd2eaf 21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set, std::equal_to, std::allocator>&) @ 0x000000001ccd371a 22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf3803a 23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d (version 24.3.12.76.altinitystable) 2024.12.16 10:56:42.741352 [ 3553 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:323: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf3ae44 21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 (version 24.3.12.76.altinitystable) 2024.12.16 10:56:45.166524 [ 3549 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::TextLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:296: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd2e93 21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set, std::equal_to, std::allocator>&) @ 0x000000001ccd371a 22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf3803a 23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d (version 24.3.12.76.altinitystable) 2024.12.16 10:56:46.648731 [ 4401 ] {537ccaa8-7930-42e7-b185-43ecda59ab87} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=23, jobs=23). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:40888) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM system.processes WHERE query_id != queryID() AND current_database = currentDatabase() AND query LIKE '%-- 11317_tuple%'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:56:46.760996 [ 4401 ] {537ccaa8-7930-42e7-b185-43ecda59ab87} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=23, jobs=23). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:56:46.932854 [ 5021 ] {4d690cc4-d3b6-4407-b1fd-f47dadaccd80} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=32, jobs=32). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:40898) (comment: 01083_window_view_select.sh) (in query: SELECT count(*) FROM wv), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:56:47.065018 [ 5021 ] {4d690cc4-d3b6-4407-b1fd-f47dadaccd80} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=32, jobs=32). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:56:49.024688 [ 4182 ] {5c33e082-fbdf-484b-a528-e99a44312652} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=1, jobs=1). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:40912) (comment: 02661_read_from_archive_tzst.sh) (in query: SELECT * FROM 02661_archive_table ORDER BY 1, 2), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:56:49.187176 [ 4182 ] {5c33e082-fbdf-484b-a528-e99a44312652} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=1, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:56:50.539651 [ 4182 ] {1aae5a9b-a406-4cb6-8921-40de5e422a9f} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=30, jobs=30). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:46312) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM system.processes WHERE query_id != queryID() AND current_database = currentDatabase() AND query LIKE '%-- 11317_tuple%'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:56:50.651662 [ 4182 ] {1aae5a9b-a406-4cb6-8921-40de5e422a9f} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=30, jobs=30). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:56:51.417928 [ 3492 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {3874c721-a658-4698-80d5-52c26fc35278::202412_1_31_6}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:310: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf3ab86 21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37f43 23. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb722bf 24. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb725d8 25. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb71fb2 26. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13ef38 27. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x000000001cba15ed 28. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x000000001cba210e 29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef, StrongTypedef, std::basic_string_view>)::'lambda'()::operator()() const @ 0x000000001cba9c78 30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba9c55 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001cba9c35 (version 24.3.12.76.altinitystable) 2024.12.16 10:56:53.751697 [ 3479 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {41d82839-5472-4425-b891-a2dc2a236577::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=5, jobs=0): (while reading column StartTime): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/41d/41d82839-5472-4425-b891-a2dc2a236577/201403_1_1_0/ in table test.visits (41d82839-5472-4425-b891-a2dc2a236577) located on disk s3_disk of type s3, from mark 1 with max_rows_to_read = 6658): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe(ThreadPoolImpl>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e92e1 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e917b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e9130 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e90f0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e907b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190eadb1 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e8d90 16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future DB::scheduleFromThreadPoolUnsafe(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl>&, String const&, Priority) @ 0x00000000190e861c 17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e7e3f 18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019365312 19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936561e 20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddc44d 21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6d168 22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6cfbd 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6cf7d 24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6cf3d 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6cf08 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd6a7e 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd2efd 28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fd02d6 29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x0000000019fd045c 30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&) @ 0x000000001ce6ab9b 31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce6a910 (version 24.3.12.76.altinitystable) 2024.12.16 10:56:54.134981 [ 3751 ] {3e999d27-be13-4999-b92d-38f83797c949} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=11, jobs=11). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:46352) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM system.processes WHERE query_id != queryID() AND current_database = currentDatabase() AND query LIKE '%-- 11317_tuple%'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:56:54.574301 [ 3751 ] {3e999d27-be13-4999-b92d-38f83797c949} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=11, jobs=11). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:56:57.066691 [ 3479 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {41d82839-5472-4425-b891-a2dc2a236577::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=31, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1fc91 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1fb3b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1faf0 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1fab0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1fa3b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce216d1 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1f750 16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future> DB::scheduleFromThreadPoolUnsafe, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl>&, String const&, Priority) @ 0x000000001ce1f09c 17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1d6c3 18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl>*, unsigned long) @ 0x000000001ce1d5b3 19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6eeac 20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, void, void>(std::allocator&, DB::MergeTreeMarksLoader*, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6edb5 21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int>(std::allocator, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6ece3 22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], std::shared_ptr&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, void>(std::allocator const&, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6eb95 23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, void>(std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6e49b 24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&, std::function const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bed3 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bbdd 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bb9d 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bb5d 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bb28 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd6a7e 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd2efd 31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fd02d6 (version 24.3.12.76.altinitystable) 2024.12.16 10:56:58.000318 [ 5021 ] {8b8028b7-29ce-4fd2-b474-5557d3110ee6} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=14, jobs=14). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:46372) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM system.processes WHERE query_id != queryID() AND current_database = currentDatabase() AND query LIKE '%-- 11317_tuple%'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:56:58.068414 [ 5021 ] {8b8028b7-29ce-4fd2-b474-5557d3110ee6} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=14, jobs=14). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:57:00.670748 [ 3491 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {41d82839-5472-4425-b891-a2dc2a236577::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=5, jobs=2): (while reading column Sign): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/41d/41d82839-5472-4425-b891-a2dc2a236577/201403_1_1_0/ in table test.visits (41d82839-5472-4425-b891-a2dc2a236577) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 6658): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe(ThreadPoolImpl>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e92e1 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e917b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e9130 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e90f0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e907b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190eadb1 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e8d90 16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future DB::scheduleFromThreadPoolUnsafe(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl>&, String const&, Priority) @ 0x00000000190e861c 17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e7e3f 18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019365312 19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936561e 20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddc44d 21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6d168 22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6cfbd 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6cf7d 24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6cf3d 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6cf08 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd6a7e 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd2efd 28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fd02d6 29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x0000000019fd045c 30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&) @ 0x000000001ce6ab9b 31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce6a910 (version 24.3.12.76.altinitystable) 2024.12.16 10:57:01.150407 [ 3591 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::BlobStorageLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=4). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:260: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf3a0a0 21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 (version 24.3.12.76.altinitystable) 2024.12.16 10:57:01.571837 [ 3751 ] {8138eb8a-7a1c-41ff-b97a-de19d4bf86d6} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=31, jobs=31). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:41866) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM system.processes WHERE query_id != queryID() AND current_database = currentDatabase() AND query LIKE '%-- 11317_tuple%'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:57:01.597846 [ 3751 ] {8138eb8a-7a1c-41ff-b97a-de19d4bf86d6} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=31, jobs=31). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:57:03.046870 [ 3492 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {41d82839-5472-4425-b891-a2dc2a236577::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=31, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1fc91 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1fb3b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1faf0 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1fab0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1fa3b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce216d1 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1f750 16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future> DB::scheduleFromThreadPoolUnsafe, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl>&, String const&, Priority) @ 0x000000001ce1f09c 17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1d6c3 18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl>*, unsigned long) @ 0x000000001ce1d5b3 19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6eeac 20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, void, void>(std::allocator&, DB::MergeTreeMarksLoader*, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6edb5 21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int>(std::allocator, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6ece3 22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], std::shared_ptr&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, void>(std::allocator const&, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6eb95 23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, void>(std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6e49b 24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&, std::function const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bed3 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bbdd 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bb9d 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bb5d 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bb28 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd6a7e 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd2efd 31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fd02d6 (version 24.3.12.76.altinitystable) 2024.12.16 10:57:05.228552 [ 5021 ] {691ec139-c680-4ef0-9eee-851232826ed2} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=21, jobs=21). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:41882) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM system.processes WHERE query_id != queryID() AND current_database = currentDatabase() AND query LIKE '%-- 11317_tuple%'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:57:05.308342 [ 5021 ] {691ec139-c680-4ef0-9eee-851232826ed2} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=21, jobs=21). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:57:06.836182 [ 5021 ] {b1392a4e-0087-44c9-b4b2-afedb84ce691} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=35, jobs=35). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:41910) (comment: 01083_window_view_select.sh) (in query: SELECT count(*) FROM wv), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:57:06.913959 [ 5021 ] {b1392a4e-0087-44c9-b4b2-afedb84ce691} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=35, jobs=35). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:57:07.319996 [ 4182 ] {42988926-6677-4d24-b737-d1a660317f88} executeQuery: Code: 636. DB::Exception: The table structure cannot be extracted from a Native format file. Error: Code: 128. DB::Exception: Array sizes are too large: 13830481612736675823. (TOO_LARGE_ARRAY_SIZE) (version 24.3.12.76.altinitystable). You can specify the structure manually. (CANNOT_EXTRACT_TABLE_STRUCTURE) (version 24.3.12.76.altinitystable) (from [::1]:41922) (comment: 02426_pod_array_overflow_2.sql) (in query: SELECT * FROM format(Native, 'k0\x23Array(Tuple(FixedString(1), Int64))\0\0\0\0\0\0\0�����\0����������������\0�\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0d\0\0\0\0\0\0\0\0\0\0\0\0\0�1?Vi�%');), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&, String&) @ 0x0000000011aa4bec 6. /build/src/Formats/ReadSchemaUtils.cpp:279: DB::readSchemaFromFormatImpl(std::optional, std::optional const&, DB::IReadBufferIterator&, std::shared_ptr const&) @ 0x000000001d4d069b 7. /build/src/Formats/ReadSchemaUtils.cpp:541: DB::readSchemaFromFormat(String const&, std::optional const&, DB::IReadBufferIterator&, std::shared_ptr const&) @ 0x000000001d4d3506 8. /build/src/TableFunctions/TableFunctionFormat.cpp:138: DB::(anonymous namespace)::TableFunctionFormat::executeImpl(std::shared_ptr const&, std::shared_ptr, String const&, DB::ColumnsDescription, bool) const @ 0x0000000018db4cfe 9. /build/src/TableFunctions/ITableFunction.cpp:37: DB::ITableFunction::execute(std::shared_ptr const&, std::shared_ptr, String const&, DB::ColumnsDescription, bool, bool) const @ 0x00000000190c56db 10. /build/src/Interpreters/Context.cpp:2014: DB::Context::executeTableFunction(std::shared_ptr const&, std::shared_ptr const&) @ 0x000000001a54a048 11. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:7558: DB::(anonymous namespace)::QueryAnalyzer::resolveTableFunction(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, DB::(anonymous namespace)::QueryExpressionsAliasVisitor&, bool) @ 0x000000001b0a6229 12. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:7917: DB::(anonymous namespace)::QueryAnalyzer::resolveQueryJoinTreeNode(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, DB::(anonymous namespace)::QueryExpressionsAliasVisitor&) @ 0x000000001b0aacb8 13. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8164: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09ccd6 14. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001b09af74 15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr&, std::shared_ptr) @ 0x000000001b09ac33 16. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr) @ 0x000000001b08c3a6 17. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr const&, DB::SelectQueryOptions const&, std::shared_ptr const&, std::shared_ptr const&) @ 0x000000001b507dac 18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x000000001b5069e6 19. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr const&, DB::SelectQueryOptions const&) @ 0x000000001b509db7 20. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50924c 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b5091fd 22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b50919d 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b50915d 24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b509125 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b428b1e 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b42409d 27. /build/src/Interpreters/InterpreterFactory.cpp:355: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000001b42372d 28. /build/src/Interpreters/executeQuery.cpp:1133: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb1cb0 29. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 30. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 31. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 2024.12.16 10:57:07.327991 [ 4182 ] {42988926-6677-4d24-b737-d1a660317f88} TCPHandler: Code: 636. DB::Exception: The table structure cannot be extracted from a Native format file. Error: Code: 128. DB::Exception: Array sizes are too large: 13830481612736675823. (TOO_LARGE_ARRAY_SIZE) (version 24.3.12.76.altinitystable). You can specify the structure manually. (CANNOT_EXTRACT_TABLE_STRUCTURE), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&, String&) @ 0x0000000011aa4bec 6. /build/src/Formats/ReadSchemaUtils.cpp:279: DB::readSchemaFromFormatImpl(std::optional, std::optional const&, DB::IReadBufferIterator&, std::shared_ptr const&) @ 0x000000001d4d069b 7. /build/src/Formats/ReadSchemaUtils.cpp:541: DB::readSchemaFromFormat(String const&, std::optional const&, DB::IReadBufferIterator&, std::shared_ptr const&) @ 0x000000001d4d3506 8. /build/src/TableFunctions/TableFunctionFormat.cpp:138: DB::(anonymous namespace)::TableFunctionFormat::executeImpl(std::shared_ptr const&, std::shared_ptr, String const&, DB::ColumnsDescription, bool) const @ 0x0000000018db4cfe 9. /build/src/TableFunctions/ITableFunction.cpp:37: DB::ITableFunction::execute(std::shared_ptr const&, std::shared_ptr, String const&, DB::ColumnsDescription, bool, bool) const @ 0x00000000190c56db 10. /build/src/Interpreters/Context.cpp:2014: DB::Context::executeTableFunction(std::shared_ptr const&, std::shared_ptr const&) @ 0x000000001a54a048 11. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:7558: DB::(anonymous namespace)::QueryAnalyzer::resolveTableFunction(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, DB::(anonymous namespace)::QueryExpressionsAliasVisitor&, bool) @ 0x000000001b0a6229 12. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:7917: DB::(anonymous namespace)::QueryAnalyzer::resolveQueryJoinTreeNode(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, DB::(anonymous namespace)::QueryExpressionsAliasVisitor&) @ 0x000000001b0aacb8 13. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8164: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09ccd6 14. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001b09af74 15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr&, std::shared_ptr) @ 0x000000001b09ac33 16. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr) @ 0x000000001b08c3a6 17. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr const&, DB::SelectQueryOptions const&, std::shared_ptr const&, std::shared_ptr const&) @ 0x000000001b507dac 18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x000000001b5069e6 19. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr const&, DB::SelectQueryOptions const&) @ 0x000000001b509db7 20. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50924c 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b5091fd 22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b50919d 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b50915d 24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b509125 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b428b1e 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b42409d 27. /build/src/Interpreters/InterpreterFactory.cpp:355: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000001b42372d 28. /build/src/Interpreters/executeQuery.cpp:1133: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb1cb0 29. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 30. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 31. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 2024.12.16 10:57:07.675145 [ 3544 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergeTreePartition.cpp:441: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000001ce2fec6 21. /build/src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001ce2f078 22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:239: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39bb5 23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 26. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 (version 24.3.12.76.altinitystable) 2024.12.16 10:57:07.714135 [ 3484 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {41d82839-5472-4425-b891-a2dc2a236577::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=5, jobs=0): (while reading column CounterID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/41d/41d82839-5472-4425-b891-a2dc2a236577/201403_4_4_0/ in table test.visits (41d82839-5472-4425-b891-a2dc2a236577) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 6741): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe(ThreadPoolImpl>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e92e1 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e917b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e9130 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e90f0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e907b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190eadb1 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e8d90 16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future DB::scheduleFromThreadPoolUnsafe(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl>&, String const&, Priority) @ 0x00000000190e861c 17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e7e3f 18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019365312 19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936561e 20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddc44d 21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6d168 22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6cfbd 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6cf7d 24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6cf3d 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6cf08 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd6a7e 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd2efd 28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fd02d6 29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x0000000019fd045c 30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&) @ 0x000000001ce6ab9b 31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce6a910 (version 24.3.12.76.altinitystable) 2024.12.16 10:57:08.814015 [ 3490 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {fe54ed48-ddd9-4cf8-aa3b-418c81cf437c::202412_1_41_8}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:294: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf3a8b6 21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37f43 23. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb722bf 24. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb725d8 25. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb71fb2 26. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13ef38 27. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x000000001cba15ed 28. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x000000001cba210e 29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef, StrongTypedef, std::basic_string_view>)::'lambda'()::operator()() const @ 0x000000001cba9c78 30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba9c55 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001cba9c35 (version 24.3.12.76.altinitystable) 2024.12.16 10:57:08.838058 [ 5021 ] {bf9a3e5f-31b8-4932-8180-34706b50da42} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=3, jobs=3). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:41926) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM system.processes WHERE query_id != queryID() AND current_database = currentDatabase() AND query LIKE '%-- 11317_tuple%'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:57:08.938020 [ 5021 ] {bf9a3e5f-31b8-4932-8180-34706b50da42} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=3, jobs=3). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:57:10.531808 [ 3751 ] {a507e804-b914-4c89-b8a7-642dc9ca35f9} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=4, jobs=4). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:58586) (comment: 03199_unbin_buffer_overflow.sh) (in query: SELECT count() FROM numbers(99) GROUP BY unbin(toFixedString(materialize('xxx'), 3)) WITH ROLLUP WITH TOTALS FORMAT NULL), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:57:10.573448 [ 3751 ] {a507e804-b914-4c89-b8a7-642dc9ca35f9} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=4, jobs=4). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:57:12.017927 [ 3751 ] {67454958-f973-4f49-a317-1973b816b860} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=23, jobs=23). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:58590) (comment: 01083_window_view_select.sh) (in query: SELECT count(*) FROM wv), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:57:12.124911 [ 3751 ] {67454958-f973-4f49-a317-1973b816b860} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=23, jobs=23). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:57:13.002727 [ 3484 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {41d82839-5472-4425-b891-a2dc2a236577::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=5, jobs=1): (while reading column StartDate): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/41d/41d82839-5472-4425-b891-a2dc2a236577/201403_4_4_0/ in table test.visits (41d82839-5472-4425-b891-a2dc2a236577) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 6741): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe(ThreadPoolImpl>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e92e1 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e917b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e9130 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e90f0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e907b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190eadb1 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e8d90 16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future DB::scheduleFromThreadPoolUnsafe(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl>&, String const&, Priority) @ 0x00000000190e861c 17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e7e3f 18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019365312 19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936561e 20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddc44d 21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6d168 22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6cfbd 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6cf7d 24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6cf3d 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6cf08 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd6a7e 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd2efd 28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fd02d6 29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x0000000019fd045c 30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&) @ 0x000000001ce6ab9b 31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce6a910 (version 24.3.12.76.altinitystable) 2024.12.16 10:57:13.682169 [ 3488 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {bdb3abf1-bb86-44b8-a138-7f8c6b07475d::202412_1_31_6}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergeTreePartition.cpp:441: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000001ce2fec6 21. /build/src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001ce2f078 22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:239: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39bb5 23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 24. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37f43 25. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb722bf 26. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb725d8 27. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb71fb2 28. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13ef38 29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x000000001cba15ed 30. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x000000001cba210e 31. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef, StrongTypedef, std::basic_string_view>)::'lambda'()::operator()() const @ 0x000000001cba9c78 (version 24.3.12.76.altinitystable) 2024.12.16 10:57:16.087645 [ 6123 ] {1ae71d67-69f2-487b-ba86-dfcd56d42cf5} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=13, jobs=13). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::ffff:127.0.0.1]:57626) (comment: 00257_shard_no_aggregates_and_constant_keys.sql) (in query: SELECT 41 AS `z` FROM `system`.`one` AS `__table1` GROUP BY 41), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:57:16.099883 [ 6123 ] {1ae71d67-69f2-487b-ba86-dfcd56d42cf5} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=13, jobs=13). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:57:16.396374 [ 3751 ] {db401375-404b-421a-8b30-e42633b162ca} executeQuery: Code: 439. DB::Exception: Received from 127.0.0.3:9000. DB::Exception: Cannot schedule a task: fault injected (threads=13, jobs=13). Stack trace: 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 : While executing Remote. (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:58600) (comment: 00257_shard_no_aggregates_and_constant_keys.sql) (in query: select 41 as z from remote('127.0.0.{2,3}', system.one) group by z;), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:89: DB::Exception::Exception(String const&, int, bool) @ 0x000000000a942caa 5. /build/src/Common/Exception.h:97: DB::Exception::createDeprecated(String const&, int, bool) @ 0x000000000a942c55 6. /build/src/IO/ReadHelpers.cpp:1560: DB::readException(DB::ReadBuffer&, String const&, bool) @ 0x0000000013369f82 7. /build/src/Client/Connection.cpp:1233: DB::Connection::receiveException() const @ 0x000000001d2bdc59 8. /build/src/Client/Connection.cpp:1070: DB::Connection::receivePacket() @ 0x000000001d2c51b1 9. /build/src/Client/PacketReceiver.cpp:66: DB::PacketReceiver::Task::run(std::function, std::function) @ 0x000000001d3320a4 10. /build/src/Common/AsyncTaskExecutor.cpp:88: DB::AsyncTaskExecutor::Routine::operator()(std::function) @ 0x0000000019ebde69 11. /build/src/Common/Fiber.h:76: Fiber::RoutineImpl::operator()(boost::context::fiber&&) @ 0x0000000019ebdd78 12. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019ebdd08 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:531: ? @ 0x0000000019ebdcc8 14. /build/contrib/boost/boost/context/fiber_fcontext.hpp:157: boost::context::detail::fiber_record>::run(void*) @ 0x0000000019ebdbfe 15. /build/contrib/boost/boost/context/fiber_fcontext.hpp:97: void boost::context::detail::fiber_entry>>(boost::context::detail::transfer_t) @ 0x0000000019ebd91d 2024.12.16 10:57:16.548841 [ 4401 ] {} ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:33498). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x00000000134e6f2c 6. /build/src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x00000000134e60a0 7. /build/src/IO/ReadBuffer.h:70: DB::ReadBuffer::next() @ 0x000000000af5ec6a 8. /build/src/IO/ReadBuffer.h:106: DB::TCPHandler::runImpl() @ 0x000000001d46ea77 9. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 10. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 11. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 12. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 13. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 14. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 15. ? @ 0x00007f713a222ac3 16. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 10:57:16.552561 [ 3751 ] {db401375-404b-421a-8b30-e42633b162ca} TCPHandler: Code: 439. DB::Exception: Received from 127.0.0.3:9000. DB::Exception: Cannot schedule a task: fault injected (threads=13, jobs=13). Stack trace: 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 : While executing Remote. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:89: DB::Exception::Exception(String const&, int, bool) @ 0x000000000a942caa 5. /build/src/Common/Exception.h:97: DB::Exception::createDeprecated(String const&, int, bool) @ 0x000000000a942c55 6. /build/src/IO/ReadHelpers.cpp:1560: DB::readException(DB::ReadBuffer&, String const&, bool) @ 0x0000000013369f82 7. /build/src/Client/Connection.cpp:1233: DB::Connection::receiveException() const @ 0x000000001d2bdc59 8. /build/src/Client/Connection.cpp:1070: DB::Connection::receivePacket() @ 0x000000001d2c51b1 9. /build/src/Client/PacketReceiver.cpp:66: DB::PacketReceiver::Task::run(std::function, std::function) @ 0x000000001d3320a4 10. /build/src/Common/AsyncTaskExecutor.cpp:88: DB::AsyncTaskExecutor::Routine::operator()(std::function) @ 0x0000000019ebde69 11. /build/src/Common/Fiber.h:76: Fiber::RoutineImpl::operator()(boost::context::fiber&&) @ 0x0000000019ebdd78 12. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019ebdd08 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:531: ? @ 0x0000000019ebdcc8 14. /build/contrib/boost/boost/context/fiber_fcontext.hpp:157: boost::context::detail::fiber_record>::run(void*) @ 0x0000000019ebdbfe 15. /build/contrib/boost/boost/context/fiber_fcontext.hpp:97: void boost::context::detail::fiber_entry>>(boost::context::detail::transfer_t) @ 0x0000000019ebd91d 2024.12.16 10:57:16.625485 [ 3493 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {41d82839-5472-4425-b891-a2dc2a236577::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=5, jobs=1): (while reading column UserID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/41d/41d82839-5472-4425-b891-a2dc2a236577/201403_3_3_0/ in table test.visits (41d82839-5472-4425-b891-a2dc2a236577) located on disk s3_disk of type s3, from mark 1 with max_rows_to_read = 6608): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe(ThreadPoolImpl>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e92e1 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e917b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e9130 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e90f0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e907b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190eadb1 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e8d90 16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future DB::scheduleFromThreadPoolUnsafe(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl>&, String const&, Priority) @ 0x00000000190e861c 17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e7e3f 18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019365312 19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936561e 20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddc44d 21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6d168 22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6cfbd 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6cf7d 24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6cf3d 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6cf08 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd6a7e 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd2efd 28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fd02d6 29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x0000000019fd045c 30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&) @ 0x000000001ce6ab9b 31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce6a910 (version 24.3.12.76.altinitystable) 2024.12.16 10:57:17.045077 [ 6123 ] {1d619785-d02d-4216-b405-53564c7f4f24} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=30, jobs=30). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:58634) (comment: 01083_window_view_select.sh) (in query: SELECT count(*) FROM wv), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:57:17.144394 [ 6123 ] {1d619785-d02d-4216-b405-53564c7f4f24} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=30, jobs=30). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:57:19.681597 [ 5021 ] {960db804-6d36-4334-b50f-142aa0adb38f} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=2, jobs=2). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:54130) (comment: 03199_unbin_buffer_overflow.sh) (in query: SELECT count() FROM numbers(99) GROUP BY unbin(toFixedString(materialize('xxxxx'), 5)) WITH ROLLUP WITH TOTALS FORMAT NULL), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:57:19.807012 [ 5021 ] {960db804-6d36-4334-b50f-142aa0adb38f} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=2, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:57:20.648808 [ 4182 ] {47fc1e60-5262-43ed-b704-aa7ebc039de5} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=1, jobs=1). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:54132) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM system.processes WHERE query_id != queryID() AND current_database = currentDatabase() AND query LIKE '%-- 11317_tuple%'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:57:20.768346 [ 4182 ] {47fc1e60-5262-43ed-b704-aa7ebc039de5} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=1, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:57:24.243263 [ 4182 ] {8e07c738-6044-4ec0-9783-0b1ebb4293ee} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=5, jobs=5). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:54156) (comment: 03199_unbin_buffer_overflow.sh) (in query: SELECT count() FROM numbers(99) GROUP BY unbin(toFixedString(materialize('xxxxxx'), 6)) WITH ROLLUP WITH TOTALS FORMAT NULL), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:57:24.270655 [ 4182 ] {8e07c738-6044-4ec0-9783-0b1ebb4293ee} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=5, jobs=5). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:57:28.175723 [ 4401 ] {fc572bb2-dd16-47ca-b0f2-df67b0c52b15} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=7, jobs=7). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:54174) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM system.processes WHERE query_id != queryID() AND current_database = currentDatabase() AND query LIKE '%-- 11317_tuple%'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:57:28.268904 [ 4401 ] {fc572bb2-dd16-47ca-b0f2-df67b0c52b15} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=7, jobs=7). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:57:31.860760 [ 4182 ] {287f212c-1738-4135-8980-864c225014fa} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=23, jobs=23). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:42938) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM system.processes WHERE query_id != queryID() AND current_database = currentDatabase() AND query LIKE '%-- 11317_tuple%'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:57:31.939316 [ 4182 ] {287f212c-1738-4135-8980-864c225014fa} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=23, jobs=23). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:57:31.990557 [ 4401 ] {708937cc-c130-4cb3-b292-b0149b3144f2} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=20, jobs=20). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:42948) (comment: 01083_window_view_select.sh) (in query: SELECT count(*) FROM wv), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:57:32.050559 [ 4401 ] {708937cc-c130-4cb3-b292-b0149b3144f2} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=20, jobs=20). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:57:34.726606 [ 3591 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::BlobStorageLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:296: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd2e93 21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set, std::equal_to, std::allocator>&) @ 0x000000001ccd371a 22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf3803a 23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d (version 24.3.12.76.altinitystable) 2024.12.16 10:57:35.694854 [ 5021 ] {2c52a43d-f271-4dc3-82dc-a6fceb971169} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=17, jobs=17). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:42962) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM system.processes WHERE query_id != queryID() AND current_database = currentDatabase() AND query LIKE '%-- 11317_tuple%'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:57:35.748823 [ 5021 ] {2c52a43d-f271-4dc3-82dc-a6fceb971169} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=17, jobs=17). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:57:39.055538 [ 5021 ] {ab77afc7-f865-4624-bb7f-db741d2d4367} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=19, jobs=19). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:36888) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM system.processes WHERE query_id != queryID() AND current_database = currentDatabase() AND query LIKE '%-- 11317_tuple%'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:57:39.192277 [ 5021 ] {ab77afc7-f865-4624-bb7f-db741d2d4367} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=19, jobs=19). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:57:47.081401 [ 5023 ] {646b210d-cb68-429a-a4ec-ce530fb6def8} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=24, jobs=24). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:36966) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM system.processes WHERE query_id != queryID() AND current_database = currentDatabase() AND query LIKE '%-- 11317_tuple%'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:57:47.159539 [ 5023 ] {646b210d-cb68-429a-a4ec-ce530fb6def8} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=24, jobs=24). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:57:51.974563 [ 5021 ] {569ef4d7-477b-4c68-b7bf-a68d14019625} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=17, jobs=17). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:60114) (comment: 01083_window_view_select.sh) (in query: SELECT count(*) FROM wv), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:57:52.043769 [ 3553 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergeTreePartition.cpp:441: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000001ce2fec6 21. /build/src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001ce2f078 22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:239: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39bb5 23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 26. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 (version 24.3.12.76.altinitystable) 2024.12.16 10:57:52.063705 [ 5021 ] {569ef4d7-477b-4c68-b7bf-a68d14019625} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=17, jobs=17). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:57:54.793435 [ 5021 ] {b0a8869d-5a4a-49fb-b83e-fbbc0d2e04b9} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=26, jobs=26). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:60116) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM system.processes WHERE query_id != queryID() AND current_database = currentDatabase() AND query LIKE '%-- 11317_tuple%'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:57:54.846634 [ 5021 ] {b0a8869d-5a4a-49fb-b83e-fbbc0d2e04b9} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=26, jobs=26). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:57:55.100696 [ 5023 ] {88f5ce3d-365b-41a8-aad8-caaeccea8a8c} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=4, jobs=4). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:60138) (comment: 03199_unbin_buffer_overflow.sh) (in query: SELECT count() FROM numbers(99) GROUP BY unbin(materialize('xxxx')) WITH ROLLUP WITH TOTALS FORMAT NULL), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:57:55.121004 [ 5023 ] {88f5ce3d-365b-41a8-aad8-caaeccea8a8c} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=4, jobs=4). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:57:56.173574 [ 3855 ] {3628d17f-83ae-4cda-be3a-b409e2e46a45} TCPHandler: Code: 241. DB::Exception: Memory limit (for query) exceeded: would use 477.12 MiB (attempt to allocate chunk of 1048592 bytes), maximum: 476.84 MiB.: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception>>(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity>>::type>, char const*&&, char const*&&, String&&, long&, String&&, char const*&&, std::basic_string_view>&&) @ 0x00000000132eb2fd 6. /build/src/Common/MemoryTracker.cpp:340: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000132e9710 7. /build/src/Common/MemoryTracker.cpp:398: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000132e9a62 8. /build/src/Common/CurrentMemoryTracker.cpp:58: CurrentMemoryTracker::allocImpl(long, bool) @ 0x00000000132566f1 9. /build/src/Common/CurrentMemoryTracker.cpp:90: CurrentMemoryTracker::alloc(long) @ 0x0000000013256901 10. /build/src/Common/AllocatorWithMemoryTracking.h:33: AllocatorWithMemoryTracking::allocate(unsigned long) @ 0x000000000a99df96 11. /build/contrib/llvm-project/libcxx/include/__memory/allocate_at_least.h:35: std::allocation_result>::pointer> std::allocate_at_least[abi:v15000]>(AllocatorWithMemoryTracking&, unsigned long) @ 0x000000000a99defd 12. /build/contrib/llvm-project/libcxx/include/__memory/allocate_at_least.h:42: auto std::__allocate_at_least[abi:v15000]>(AllocatorWithMemoryTracking&, unsigned long) @ 0x000000000a99dddd 13. /build/contrib/llvm-project/libcxx/include/__split_buffer:316: std::__split_buffer&>::__split_buffer(unsigned long, unsigned long, AllocatorWithMemoryTracking&) @ 0x000000000b9ca0cb 14. /build/contrib/llvm-project/libcxx/include/vector:1048: std::vector>::__append(unsigned long) @ 0x0000000013e9747f 15. /build/contrib/llvm-project/libcxx/include/vector:1918: std::vector>::resize(unsigned long) @ 0x0000000013e971a0 16. /build/src/AggregateFunctions/AggregateFunctionSumMap.cpp:229: DB::(anonymous namespace)::AggregateFunctionMapBase, DB::FieldVisitorSum, false, false, true>::add(char*, DB::IColumn const**, unsigned long, DB::Arena*) const @ 0x0000000014c87a3f 17. /build/src/AggregateFunctions/IAggregateFunction.h:536: DB::IAggregateFunctionHelper>::addBatchSinglePlace(unsigned long, unsigned long, char*, DB::IColumn const**, DB::Arena*, long) const @ 0x0000000014c8a5ea 18. /build/src/Interpreters/Aggregator.cpp:0: DB::Aggregator::addBatchSinglePlace(unsigned long, unsigned long, DB::Aggregator::AggregateFunctionInstruction*, char*, DB::Arena*) @ 0x000000001a72f5d6 19. /build/src/Interpreters/Aggregator.cpp:1344: DB::Aggregator::executeWithoutKeyImpl(char*&, unsigned long, unsigned long, DB::Aggregator::AggregateFunctionInstruction*, DB::Arena*, bool) const @ 0x000000001a72fa25 20. /build/src/Interpreters/Aggregator.cpp:1611: DB::Aggregator::executeOnBlock(std::vector::immutable_ptr, std::allocator::immutable_ptr>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector>&, std::vector>, std::allocator>>>&, bool&) const @ 0x000000001a7319c8 21. /build/src/Processors/Transforms/AggregatingTransform.cpp:692: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000001dc98333 22. /build/src/Processors/Transforms/AggregatingTransform.cpp:651: DB::AggregatingTransform::work() @ 0x000000001dc95439 23. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 24. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 25. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 26. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 27. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 2024.12.16 10:57:56.936737 [ 4402 ] {0ee5d2bd-b137-4000-b0a8-dfe61bb6e3fc} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=34, jobs=34). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:60154) (comment: 01083_window_view_select.sh) (in query: SELECT count(*) FROM wv), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:57:56.987746 [ 4402 ] {0ee5d2bd-b137-4000-b0a8-dfe61bb6e3fc} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=34, jobs=34). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:57:58.369946 [ 4402 ] {5aeaaa66-994f-4e98-b71b-5c5316d9638e} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=9, jobs=9). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:60170) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM system.processes WHERE query_id != queryID() AND current_database = currentDatabase() AND query LIKE '%-- 11317_tuple%'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:57:58.449412 [ 4402 ] {5aeaaa66-994f-4e98-b71b-5c5316d9638e} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=9, jobs=9). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:58:01.952128 [ 6123 ] {645bb3a1-3882-4701-a6e3-c06c163da3da} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=14). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:42612) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM system.processes WHERE query_id != queryID() AND current_database = currentDatabase() AND query LIKE '%-- 11317_tuple%'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:58:02.005365 [ 6123 ] {645bb3a1-3882-4701-a6e3-c06c163da3da} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=14). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:58:04.000401 [ 4402 ] {d23532bf-6096-415c-a163-a279fb3c3c9d} executeQuery: Code: 48. DB::Exception: ReplicatedMergeTree (table test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9)) does not support transactions. (NOT_IMPLEMENTED) (version 24.3.12.76.altinitystable) (from [::1]:42592) (comment: 01650_drop_part_and_deduplication_zookeeper_long.sql) (in query: INSERT INTO partitioned_table VALUES ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000a8efdf3 6. /build/src/Interpreters/IInterpreter.cpp:49: DB::IInterpreter::checkStorageSupportsTransactionsIfNeeded(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000001b007ff6 7. /build/src/Interpreters/InterpreterInsertQuery.cpp:407: DB::InterpreterInsertQuery::execute() @ 0x000000001b42bc0e 8. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 9. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 10. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 11. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 12. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 13. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 14. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 15. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 16. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 17. ? @ 0x00007f713a222ac3 18. ? @ 0x00007f713a2b4850 2024.12.16 10:58:04.036062 [ 4402 ] {d23532bf-6096-415c-a163-a279fb3c3c9d} TCPHandler: Code: 48. DB::Exception: ReplicatedMergeTree (table test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9)) does not support transactions. (NOT_IMPLEMENTED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000a8efdf3 6. /build/src/Interpreters/IInterpreter.cpp:49: DB::IInterpreter::checkStorageSupportsTransactionsIfNeeded(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000001b007ff6 7. /build/src/Interpreters/InterpreterInsertQuery.cpp:407: DB::InterpreterInsertQuery::execute() @ 0x000000001b42bc0e 8. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 9. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 10. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 11. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 12. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 13. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 14. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 15. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 16. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 17. ? @ 0x00007f713a222ac3 18. ? @ 0x00007f713a2b4850 2024.12.16 10:58:04.635203 [ 5021 ] {cfb04117-eafa-4d65-b2d0-fafeb360c7d0} executeQuery: Code: 48. DB::Exception: ReplicatedMergeTree (table test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9)) does not support transactions. (NOT_IMPLEMENTED) (version 24.3.12.76.altinitystable) (from [::1]:37854) (comment: 01650_drop_part_and_deduplication_zookeeper_long.sql) (in query: DROP DATABASE IF EXISTS test_8hof96gt ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000a8efdf3 6. /build/src/Interpreters/IInterpreter.cpp:49: DB::IInterpreter::checkStorageSupportsTransactionsIfNeeded(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000001b007ff6 7. /build/src/Interpreters/InterpreterDropQuery.cpp:141: DB::InterpreterDropQuery::executeToTableImpl(std::shared_ptr, DB::ASTDropQuery&, std::shared_ptr&, StrongTypedef, DB::UUIDTag>&) @ 0x000000001b03c23f 8. /build/src/Interpreters/InterpreterDropQuery.cpp:416: DB::InterpreterDropQuery::executeToDatabaseImpl(DB::ASTDropQuery const&, std::shared_ptr&, std::vector, DB::UUIDTag>, std::allocator, DB::UUIDTag>>>&) @ 0x000000001b03f1c3 9. /build/src/Interpreters/InterpreterDropQuery.cpp:335: DB::InterpreterDropQuery::executeToDatabase(DB::ASTDropQuery const&) @ 0x000000001b03b6d9 10. /build/src/Interpreters/InterpreterDropQuery.cpp:81: DB::InterpreterDropQuery::execute() @ 0x000000001b03ae04 11. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 12. /build/src/Interpreters/executeQuery.cpp:1496: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb4e89 13. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 14. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 2024.12.16 10:58:04.651984 [ 5021 ] {cfb04117-eafa-4d65-b2d0-fafeb360c7d0} DynamicQueryHandler: Code: 48. DB::Exception: ReplicatedMergeTree (table test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9)) does not support transactions. (NOT_IMPLEMENTED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000a8efdf3 6. /build/src/Interpreters/IInterpreter.cpp:49: DB::IInterpreter::checkStorageSupportsTransactionsIfNeeded(std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000001b007ff6 7. /build/src/Interpreters/InterpreterDropQuery.cpp:141: DB::InterpreterDropQuery::executeToTableImpl(std::shared_ptr, DB::ASTDropQuery&, std::shared_ptr&, StrongTypedef, DB::UUIDTag>&) @ 0x000000001b03c23f 8. /build/src/Interpreters/InterpreterDropQuery.cpp:416: DB::InterpreterDropQuery::executeToDatabaseImpl(DB::ASTDropQuery const&, std::shared_ptr&, std::vector, DB::UUIDTag>, std::allocator, DB::UUIDTag>>>&) @ 0x000000001b03f1c3 9. /build/src/Interpreters/InterpreterDropQuery.cpp:335: DB::InterpreterDropQuery::executeToDatabase(DB::ASTDropQuery const&) @ 0x000000001b03b6d9 10. /build/src/Interpreters/InterpreterDropQuery.cpp:81: DB::InterpreterDropQuery::execute() @ 0x000000001b03ae04 11. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 12. /build/src/Interpreters/executeQuery.cpp:1496: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb4e89 13. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 14. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 10:58:06.840541 [ 6123 ] {36705a3f-ad07-4952-b59e-874c509d565e} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=3, jobs=3). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:42644) (comment: 01083_window_view_select.sh) (in query: SELECT count(*) FROM wv), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:58:06.901988 [ 6123 ] {36705a3f-ad07-4952-b59e-874c509d565e} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=3, jobs=3). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:58:08.288494 [ 3156 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:58:09.286959 [ 3751 ] {8f4b59fc-ac1a-461e-8e08-5a1b9abf782e} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=8, jobs=8). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:35104) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM system.processes WHERE query_id != queryID() AND current_database = currentDatabase() AND query LIKE '%-- 11317_tuple%'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:58:09.294758 [ 3170 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:58:09.327786 [ 3553 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=3). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:296: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd2e93 21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set, std::equal_to, std::allocator>&) @ 0x000000001ccd371a 22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf3803a 23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d (version 24.3.12.76.altinitystable) 2024.12.16 10:58:09.378378 [ 3751 ] {8f4b59fc-ac1a-461e-8e08-5a1b9abf782e} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=8, jobs=8). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:58:10.308115 [ 3176 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:58:11.326976 [ 3201 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:58:12.334520 [ 3217 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:58:12.626414 [ 4402 ] {618ba14a-771f-49ed-85d8-72d8537bfb9c} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=3, jobs=3). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:35118) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM system.processes WHERE query_id != queryID() AND current_database = currentDatabase() AND query LIKE '%-- 11317_tuple%'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:58:12.673801 [ 4402 ] {618ba14a-771f-49ed-85d8-72d8537bfb9c} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=3, jobs=3). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:58:13.045163 [ 6123 ] {2f15802b-610d-49c7-acc2-33fe6b5816ff} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:35124) (comment: 03199_unbin_buffer_overflow.sh) (in query: SELECT count() FROM numbers(99) GROUP BY unbin(materialize('xxxxxxxx')) WITH ROLLUP WITH TOTALS FORMAT NULL), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:58:13.100939 [ 6123 ] {2f15802b-610d-49c7-acc2-33fe6b5816ff} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:58:13.344758 [ 3226 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:58:14.352791 [ 3246 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:58:15.360893 [ 3177 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:58:16.369800 [ 3269 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:58:16.636833 [ 5021 ] {fe25232f-375a-4ead-a49b-d3d5e7fefad1} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=27, jobs=27). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:35154) (comment: 01083_window_view_select.sh) (in query: SELECT count(*) FROM wv), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:58:16.696797 [ 5021 ] {fe25232f-375a-4ead-a49b-d3d5e7fefad1} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=27, jobs=27). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:58:17.376775 [ 3288 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:58:18.422226 [ 3303 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:58:18.501888 [ 3565 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergeTreePartition.cpp:441: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000001ce2fec6 21. /build/src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001ce2f078 22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:239: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39bb5 23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 26. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 (version 24.3.12.76.altinitystable) 2024.12.16 10:58:19.041229 [ 3487 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {fe54ed48-ddd9-4cf8-aa3b-418c81cf437c::202412_1_53_10}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=31, jobs=3). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1fc91 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1fb3b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1faf0 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1fab0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1fa3b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce216d1 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1f750 16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future> DB::scheduleFromThreadPoolUnsafe, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl>&, String const&, Priority) @ 0x000000001ce1f09c 17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1d6c3 18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl>*, unsigned long) @ 0x000000001ce1d5b3 19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*, unsigned long, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&&, unsigned long&&) @ 0x000000001ce56a2c 20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*, unsigned long, void, void>(std::allocator&, DB::MergeTreeMarksLoader*, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&&, unsigned long&&) @ 0x000000001ce56935 21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*, unsigned long>(std::allocator, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&&, unsigned long&&) @ 0x000000001ce56863 22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], std::shared_ptr&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*, unsigned long, void>(std::allocator const&, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&&, unsigned long&&) @ 0x000000001ce56715 23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*, unsigned long, void>(std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&&, unsigned long&&) @ 0x000000001ce53cbb 24. /build/src/Storages/MergeTree/MergeTreeReaderCompact.cpp:37: DB::MergeTreeReaderCompact::MergeTreeReaderCompact(std::shared_ptr, DB::NamesAndTypesList, std::unordered_map, std::equal_to, std::allocator>> const&, std::shared_ptr const&, DB::UncompressedCache*, DB::MarkCache*, DB::MarkRanges, DB::MergeTreeReaderSettings, std::map, std::allocator>>, std::function const&, int) @ 0x000000001ce51f0a 25. /build/src/Storages/MergeTree/MergeTreeReaderCompactSingleBuffer.h:16: DB::MergeTreeReaderCompactSingleBuffer::MergeTreeReaderCompactSingleBuffer&, DB::NamesAndTypesList const&, std::unordered_map, std::equal_to, std::allocator>> const&, std::shared_ptr const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map, std::allocator>> const&, std::function const&, int>(std::shared_ptr&, DB::NamesAndTypesList const&, std::unordered_map, std::equal_to, std::allocator>> const&, std::shared_ptr const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map, std::allocator>> const&, std::function const&, int&&) @ 0x000000001ccc27a5 26. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, DB::NamesAndTypesList const&, std::unordered_map, std::equal_to, std::allocator>> const&, std::shared_ptr const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map, std::allocator>> const&, std::function const&, int>(std::shared_ptr&, DB::NamesAndTypesList const&, std::unordered_map, std::equal_to, std::allocator>> const&, std::shared_ptr const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map, std::allocator>> const&, std::function const&, int&&) @ 0x000000001ccc1b7d 27. /build/src/Storages/MergeTree/MergeTreeDataPartCompact.cpp:43: DB::MergeTreeDataPartCompact::getReader(DB::NamesAndTypesList const&, std::shared_ptr const&, DB::MarkRanges const&, std::unordered_map, std::equal_to, std::allocator>> const&, DB::UncompressedCache*, DB::MarkCache*, std::shared_ptr const&, DB::MergeTreeReaderSettings const&, std::map, std::allocator>> const&, std::function const&) const @ 0x000000001ccbeef3 28. /build/src/Storages/MergeTree/MergeTreeSequentialSource.cpp:177: DB::MergeTreeSequentialSource::MergeTreeSequentialSource(DB::MergeTreeSequentialSourceType, DB::MergeTreeData const&, std::shared_ptr const&, std::shared_ptr, std::vector>, std::optional, bool, bool, bool, bool) @ 0x000000001ce71ef0 29. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeSequentialSource* std::construct_at[abi:v15000] const&, std::shared_ptr&, std::vector>&, std::optional, bool, bool&, bool&, bool&, DB::MergeTreeSequentialSource*>(DB::MergeTreeSequentialSource*, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr const&, std::shared_ptr&, std::vector>&, std::optional&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce76047 30. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000] const&, std::shared_ptr&, std::vector>&, std::optional, bool, bool&, bool&, bool&, void, void>(std::allocator&, DB::MergeTreeSequentialSource*, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr const&, std::shared_ptr&, std::vector>&, std::optional&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce75d04 31. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000] const&, std::shared_ptr&, std::vector>&, std::optional, bool, bool&, bool&, bool&>(std::allocator, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr const&, std::shared_ptr&, std::vector>&, std::optional&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce759b1 (version 24.3.12.76.altinitystable) 2024.12.16 10:58:19.433757 [ 3262 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:58:19.762309 [ 4402 ] {9f01d92c-f064-4caf-8958-d5d39820ab85} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=25, jobs=25). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:51086) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM system.processes WHERE query_id != queryID() AND current_database = currentDatabase() AND query LIKE '%-- 11317_tuple%'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:58:19.798772 [ 4402 ] {9f01d92c-f064-4caf-8958-d5d39820ab85} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=25, jobs=25). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:58:20.351131 [ 3483 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {543b302c-96aa-4ec0-9035-9e47ab548ac9::202412_1_46_9}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:296: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd2e93 21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set, std::equal_to, std::allocator>&) @ 0x000000001ccd371a 22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf3803a 23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37f43 24. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb722bf 25. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb725d8 26. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb71fb2 27. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13ef38 28. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x000000001cba15ed 29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x000000001cba210e 30. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef, StrongTypedef, std::basic_string_view>)::'lambda'()::operator()() const @ 0x000000001cba9c78 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba9c55 (version 24.3.12.76.altinitystable) 2024.12.16 10:58:20.441554 [ 3338 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:58:21.454655 [ 3352 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:58:22.214512 [ 6123 ] {906b9176-cf21-4bc6-8e84-0560359e99e3} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=1). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:51094) (comment: 01083_window_view_select.sh) (in query: SELECT count(*) FROM wv), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:58:22.251344 [ 6123 ] {906b9176-cf21-4bc6-8e84-0560359e99e3} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:58:22.465058 [ 3490 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {41d82839-5472-4425-b891-a2dc2a236577::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=31, jobs=5). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1fc91 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1fb3b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1faf0 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1fab0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1fa3b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce216d1 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1f750 16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future> DB::scheduleFromThreadPoolUnsafe, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl>&, String const&, Priority) @ 0x000000001ce1f09c 17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1d6c3 18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl>*, unsigned long) @ 0x000000001ce1d5b3 19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6eeac 20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, void, void>(std::allocator&, DB::MergeTreeMarksLoader*, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6edb5 21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int>(std::allocator, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6ece3 22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], std::shared_ptr&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, void>(std::allocator const&, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6eb95 23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, void>(std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6e49b 24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&, std::function const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bed3 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bbdd 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bb9d 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bb5d 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bb28 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd6a7e 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd2efd 31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fd02d6 (version 24.3.12.76.altinitystable) 2024.12.16 10:58:22.689052 [ 3360 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:58:22.806958 [ 3487 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {a1d2c310-018e-47c7-a0f2-837bf40ba898::202412_1_35_7}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:323: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf3ae44 21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37f43 23. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb722bf 24. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb725d8 25. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb71fb2 26. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13ef38 27. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x000000001cba15ed 28. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x000000001cba210e 29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef, StrongTypedef, std::basic_string_view>)::'lambda'()::operator()() const @ 0x000000001cba9c78 30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba9c55 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001cba9c35 (version 24.3.12.76.altinitystable) 2024.12.16 10:58:23.694704 [ 2866 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:58:24.722479 [ 2886 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:58:25.755340 [ 2899 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:58:26.791704 [ 2868 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:58:27.069652 [ 3751 ] {f1ecb33f-9a86-4be0-a52f-f63d8c7aa797} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=6, jobs=6). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:51118) (comment: 02559_multiple_read_steps_in_prewhere.sql) (in query: INSERT INTO test_02559 SELECT number, number FROM numbers(10);), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:58:27.190123 [ 3751 ] {f1ecb33f-9a86-4be0-a52f-f63d8c7aa797} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=6, jobs=6). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:58:27.288140 [ 6123 ] {680f01aa-310a-465a-983e-e0e5fc744ea8} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=9, jobs=3): (while reading column URL): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/e18/e1847c50-0f31-4b64-b9f3-d304288fec50/201403_1_6_1/ in table test.hits (e1847c50-0f31-4b64-b9f3-d304288fec50) located on disk s3_disk of type s3, from mark 106 with max_rows_to_read = 8192): While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:51116) (comment: 00139_like.sql) (in query: /* Note that queries are written as the user doesn't really understand that the symbol _ has special meaning in LIKE pattern. */ SELECT count() FROM test.hits WHERE URL LIKE '%/avtomobili_s_probegom/_%__%__%__%';), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe(ThreadPoolImpl>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e92e1 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e917b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e9130 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e90f0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e907b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190eadb1 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e8d90 16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future DB::scheduleFromThreadPoolUnsafe(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl>&, String const&, Priority) @ 0x00000000190e861c 17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e7e3f 18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019365312 19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936561e 20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddc44d 21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6d168 22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6cfbd 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6cf7d 24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6cf3d 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6cf08 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd6a7e 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd2efd 28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fd02d6 29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x0000000019fd045c 30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&) @ 0x000000001ce6ab9b 31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce6a910 2024.12.16 10:58:27.670206 [ 3855 ] {efee45d5-231e-4c52-b7f7-7f046a3072b3} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=25, jobs=25). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:51132) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM system.processes WHERE query_id != queryID() AND current_database = currentDatabase() AND query LIKE '%-- 11317_tuple%'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:58:27.763729 [ 3855 ] {efee45d5-231e-4c52-b7f7-7f046a3072b3} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=25, jobs=25). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:58:27.798748 [ 2934 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:58:28.034534 [ 6123 ] {680f01aa-310a-465a-983e-e0e5fc744ea8} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=9, jobs=3): (while reading column URL): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/e18/e1847c50-0f31-4b64-b9f3-d304288fec50/201403_1_6_1/ in table test.hits (e1847c50-0f31-4b64-b9f3-d304288fec50) located on disk s3_disk of type s3, from mark 106 with max_rows_to_read = 8192): While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe(ThreadPoolImpl>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e92e1 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e917b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e9130 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e90f0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e907b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190eadb1 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e8d90 16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future DB::scheduleFromThreadPoolUnsafe(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl>&, String const&, Priority) @ 0x00000000190e861c 17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e7e3f 18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019365312 19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936561e 20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddc44d 21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6d168 22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6cfbd 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6cf7d 24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6cf3d 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6cf08 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd6a7e 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd2efd 28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fd02d6 29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x0000000019fd045c 30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&) @ 0x000000001ce6ab9b 31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce6a910 2024.12.16 10:58:28.822755 [ 2946 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:58:29.766961 [ 3481 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {a1d2c310-018e-47c7-a0f2-837bf40ba898::202412_1_35_7}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:294: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf3a8b6 21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37f43 23. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb722bf 24. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb725d8 25. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb71fb2 26. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13ef38 27. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x000000001cba15ed 28. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x000000001cba210e 29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef, StrongTypedef, std::basic_string_view>)::'lambda'()::operator()() const @ 0x000000001cba9c78 30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba9c55 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001cba9c35 (version 24.3.12.76.altinitystable) 2024.12.16 10:58:29.832278 [ 2958 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:58:30.853058 [ 2980 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:58:31.869601 [ 2999 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:58:32.475010 [ 4182 ] {c4eb5bdf-7f04-40c2-b714-0cdd68f3ec9a} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=2, jobs=2). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:55174) (comment: 01083_window_view_select.sh) (in query: SELECT count(*) FROM wv), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:58:32.518562 [ 4182 ] {c4eb5bdf-7f04-40c2-b714-0cdd68f3ec9a} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=2, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:58:32.896668 [ 3013 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:58:33.904296 [ 3030 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:58:34.914810 [ 3043 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:58:34.973087 [ 6123 ] {1f3702a9-e29d-4775-a26d-7675fcb9ec25} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:55184) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM system.processes WHERE query_id != queryID() AND current_database = currentDatabase() AND query LIKE '%-- 11317_tuple%'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:58:35.131248 [ 6123 ] {1f3702a9-e29d-4775-a26d-7675fcb9ec25} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:58:35.353138 [ 3855 ] {72d09ff1-5d1d-4438-a485-81eb30261946} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=19, jobs=19). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:55158) (comment: 00035_aggregate_keys128.sql) (in query: SELECT SearchEngineID AS k1, AdvEngineID AS k2, count() AS c FROM test.hits GROUP BY k1, k2 ORDER BY c DESC, k1, k2 LIMIT 10 ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:58:35.927416 [ 3051 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:58:36.463784 [ 3855 ] {72d09ff1-5d1d-4438-a485-81eb30261946} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=19, jobs=19). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:58:36.938028 [ 3064 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:58:37.456374 [ 3855 ] {c867c37b-f20d-4d8f-a486-a595968b749c} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=30, jobs=30). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:55230) (comment: 01083_window_view_select.sh) (in query: SELECT count(*) FROM wv), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:58:37.527687 [ 3855 ] {c867c37b-f20d-4d8f-a486-a595968b749c} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=30, jobs=30). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:58:37.946467 [ 3035 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:58:38.891268 [ 3855 ] {f30e48a1-1a3f-441a-85fa-70747b22881b} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=21, jobs=21). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:55234) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM system.processes WHERE query_id != queryID() AND current_database = currentDatabase() AND query LIKE '%-- 11317_tuple%'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:58:38.955446 [ 2918 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:58:38.961359 [ 3855 ] {f30e48a1-1a3f-441a-85fa-70747b22881b} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=21, jobs=21). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:58:39.966485 [ 3002 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:58:40.230192 [ 6123 ] {c622b464-80c4-4475-9d22-917d1545e30f} executeQuery: Code: 507. DB::Exception: Sharding key dummy is not used. (UNABLE_TO_SKIP_UNUSED_SHARDS) (version 24.3.12.76.altinitystable) (from [::1]:55200) (comment: 01757_optimize_skip_unused_shards_limit.sql) (in query: -- in negative select * from dist_01757 where dummy in (0, 1) settings optimize_skip_unused_shards_limit=1;), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageDistributed.cpp:1556: DB::StorageDistributed::getOptimizedCluster(std::shared_ptr, std::shared_ptr const&, DB::SelectQueryInfo const&, std::shared_ptr const&) const @ 0x000000001c3336c5 7. /build/src/Storages/StorageDistributed.cpp:441: DB::StorageDistributed::getQueryProcessingStage(std::shared_ptr, DB::QueryProcessingStage::Enum, std::shared_ptr const&, DB::SelectQueryInfo&) const @ 0x000000001c331bd0 8. /build/src/Planner/PlannerJoinTree.cpp:875: DB::(anonymous namespace)::buildQueryPlanForTableExpression(std::shared_ptr, DB::SelectQueryInfo const&, DB::SelectQueryOptions const&, std::shared_ptr&, bool, bool) @ 0x000000001b552f66 9. /build/src/Planner/PlannerJoinTree.cpp:1667: DB::buildJoinTreeQueryPlan(std::shared_ptr const&, DB::SelectQueryInfo const&, DB::SelectQueryOptions&, std::unordered_set, std::equal_to, std::allocator> const&, std::shared_ptr&) @ 0x000000001b54e710 10. /build/src/Planner/Planner.cpp:1473: DB::Planner::buildPlanForQueryNode() @ 0x000000001b50f506 11. /build/src/Planner/Planner.cpp:0: DB::Planner::buildQueryPlanIfNeeded() @ 0x000000001b50b655 12. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:234: DB::InterpreterSelectQueryAnalyzer::getQueryPlan() @ 0x000000001b50885d 13. /build/src/Interpreters/executeQuery.cpp:1146: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb2012 14. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 15. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 16. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 17. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 18. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 19. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 20. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 21. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 22. ? @ 0x00007f713a222ac3 23. ? @ 0x00007f713a2b4850 2024.12.16 10:58:40.248288 [ 6123 ] {c622b464-80c4-4475-9d22-917d1545e30f} TCPHandler: Code: 507. DB::Exception: Sharding key dummy is not used. (UNABLE_TO_SKIP_UNUSED_SHARDS), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageDistributed.cpp:1556: DB::StorageDistributed::getOptimizedCluster(std::shared_ptr, std::shared_ptr const&, DB::SelectQueryInfo const&, std::shared_ptr const&) const @ 0x000000001c3336c5 7. /build/src/Storages/StorageDistributed.cpp:441: DB::StorageDistributed::getQueryProcessingStage(std::shared_ptr, DB::QueryProcessingStage::Enum, std::shared_ptr const&, DB::SelectQueryInfo&) const @ 0x000000001c331bd0 8. /build/src/Planner/PlannerJoinTree.cpp:875: DB::(anonymous namespace)::buildQueryPlanForTableExpression(std::shared_ptr, DB::SelectQueryInfo const&, DB::SelectQueryOptions const&, std::shared_ptr&, bool, bool) @ 0x000000001b552f66 9. /build/src/Planner/PlannerJoinTree.cpp:1667: DB::buildJoinTreeQueryPlan(std::shared_ptr const&, DB::SelectQueryInfo const&, DB::SelectQueryOptions&, std::unordered_set, std::equal_to, std::allocator> const&, std::shared_ptr&) @ 0x000000001b54e710 10. /build/src/Planner/Planner.cpp:1473: DB::Planner::buildPlanForQueryNode() @ 0x000000001b50f506 11. /build/src/Planner/Planner.cpp:0: DB::Planner::buildQueryPlanIfNeeded() @ 0x000000001b50b655 12. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:234: DB::InterpreterSelectQueryAnalyzer::getQueryPlan() @ 0x000000001b50885d 13. /build/src/Interpreters/executeQuery.cpp:1146: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb2012 14. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 15. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 16. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 17. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 18. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 19. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 20. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 21. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 22. ? @ 0x00007f713a222ac3 23. ? @ 0x00007f713a2b4850 2024.12.16 10:58:40.250611 [ 3544 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:323: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf3ae44 21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 (version 24.3.12.76.altinitystable) 2024.12.16 10:58:40.619389 [ 6123 ] {78222ee7-0e2e-43db-9be9-86472ba8d6ce} executeQuery: Code: 507. DB::Exception: Sharding key dummy is not used. (UNABLE_TO_SKIP_UNUSED_SHARDS) (version 24.3.12.76.altinitystable) (from [::1]:55200) (comment: 01757_optimize_skip_unused_shards_limit.sql) (in query: -- or negative select * from dist_01757 where dummy = 0 or dummy = 1 settings optimize_skip_unused_shards_limit=1;), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageDistributed.cpp:1556: DB::StorageDistributed::getOptimizedCluster(std::shared_ptr, std::shared_ptr const&, DB::SelectQueryInfo const&, std::shared_ptr const&) const @ 0x000000001c3336c5 7. /build/src/Storages/StorageDistributed.cpp:441: DB::StorageDistributed::getQueryProcessingStage(std::shared_ptr, DB::QueryProcessingStage::Enum, std::shared_ptr const&, DB::SelectQueryInfo&) const @ 0x000000001c331bd0 8. /build/src/Planner/PlannerJoinTree.cpp:875: DB::(anonymous namespace)::buildQueryPlanForTableExpression(std::shared_ptr, DB::SelectQueryInfo const&, DB::SelectQueryOptions const&, std::shared_ptr&, bool, bool) @ 0x000000001b552f66 9. /build/src/Planner/PlannerJoinTree.cpp:1667: DB::buildJoinTreeQueryPlan(std::shared_ptr const&, DB::SelectQueryInfo const&, DB::SelectQueryOptions&, std::unordered_set, std::equal_to, std::allocator> const&, std::shared_ptr&) @ 0x000000001b54e710 10. /build/src/Planner/Planner.cpp:1473: DB::Planner::buildPlanForQueryNode() @ 0x000000001b50f506 11. /build/src/Planner/Planner.cpp:0: DB::Planner::buildQueryPlanIfNeeded() @ 0x000000001b50b655 12. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:234: DB::InterpreterSelectQueryAnalyzer::getQueryPlan() @ 0x000000001b50885d 13. /build/src/Interpreters/executeQuery.cpp:1146: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb2012 14. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 15. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 16. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 17. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 18. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 19. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 20. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 21. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 22. ? @ 0x00007f713a222ac3 23. ? @ 0x00007f713a2b4850 2024.12.16 10:58:40.637925 [ 6123 ] {78222ee7-0e2e-43db-9be9-86472ba8d6ce} TCPHandler: Code: 507. DB::Exception: Sharding key dummy is not used. (UNABLE_TO_SKIP_UNUSED_SHARDS), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageDistributed.cpp:1556: DB::StorageDistributed::getOptimizedCluster(std::shared_ptr, std::shared_ptr const&, DB::SelectQueryInfo const&, std::shared_ptr const&) const @ 0x000000001c3336c5 7. /build/src/Storages/StorageDistributed.cpp:441: DB::StorageDistributed::getQueryProcessingStage(std::shared_ptr, DB::QueryProcessingStage::Enum, std::shared_ptr const&, DB::SelectQueryInfo&) const @ 0x000000001c331bd0 8. /build/src/Planner/PlannerJoinTree.cpp:875: DB::(anonymous namespace)::buildQueryPlanForTableExpression(std::shared_ptr, DB::SelectQueryInfo const&, DB::SelectQueryOptions const&, std::shared_ptr&, bool, bool) @ 0x000000001b552f66 9. /build/src/Planner/PlannerJoinTree.cpp:1667: DB::buildJoinTreeQueryPlan(std::shared_ptr const&, DB::SelectQueryInfo const&, DB::SelectQueryOptions&, std::unordered_set, std::equal_to, std::allocator> const&, std::shared_ptr&) @ 0x000000001b54e710 10. /build/src/Planner/Planner.cpp:1473: DB::Planner::buildPlanForQueryNode() @ 0x000000001b50f506 11. /build/src/Planner/Planner.cpp:0: DB::Planner::buildQueryPlanIfNeeded() @ 0x000000001b50b655 12. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:234: DB::InterpreterSelectQueryAnalyzer::getQueryPlan() @ 0x000000001b50885d 13. /build/src/Interpreters/executeQuery.cpp:1146: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb2012 14. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 15. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 16. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 17. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 18. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 19. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 20. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 21. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 22. ? @ 0x00007f713a222ac3 23. ? @ 0x00007f713a2b4850 2024.12.16 10:58:40.977376 [ 3081 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:58:41.266557 [ 6123 ] {f1e0c294-5b18-449b-9fc3-5aa8f259ba4b} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=1, jobs=1). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:55200) (comment: 01757_optimize_skip_unused_shards_limit.sql) (in query: -- or select * from dist_01757 where dummy = 0 or dummy = 1 format Null settings optimize_skip_unused_shards_limit=2;), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:58:41.272472 [ 6123 ] {f1e0c294-5b18-449b-9fc3-5aa8f259ba4b} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=1, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:58:41.747106 [ 2758 ] {4503acce-a3aa-4db0-bc90-081070b626db} executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:43968). (NETWORK_ERROR) (version 24.3.12.76.altinitystable) (from [::ffff:127.0.0.1]:43968) (comment: 01757_optimize_skip_unused_shards_limit.sql) (in query: SELECT `__table1`.`dummy` AS `dummy` FROM `system`.`one` AS `__table1` WHERE (`__table1`.`dummy` = 0) OR (`__table1`.`dummy` = 1)), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:169: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000134e8a44 7. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 8. /build/src/Server/TCPHandler.cpp:2217: DB::TCPHandler::sendData(DB::Block const&) @ 0x000000001d47d38f 9. /build/src/Server/TCPHandler.cpp:1055: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d47af99 10. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d47005b 11. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 12. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 13. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 14. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 15. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 16. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 17. ? @ 0x00007f713a222ac3 18. ? @ 0x00007f713a2b4850 2024.12.16 10:58:41.919949 [ 2758 ] {4503acce-a3aa-4db0-bc90-081070b626db} TCPHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:43968). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:169: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000134e8a44 7. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 8. /build/src/Server/TCPHandler.cpp:2217: DB::TCPHandler::sendData(DB::Block const&) @ 0x000000001d47d38f 9. /build/src/Server/TCPHandler.cpp:1055: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d47af99 10. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d47005b 11. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 12. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 13. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 14. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 15. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 16. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 17. ? @ 0x00007f713a222ac3 18. ? @ 0x00007f713a2b4850 2024.12.16 10:58:41.921505 [ 2758 ] {4503acce-a3aa-4db0-bc90-081070b626db} TCPHandler: Client has gone away. 2024.12.16 10:58:41.924557 [ 2756 ] {c34b2cf6-7af8-47d9-93ee-5cf712156a5b} executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:44374). (NETWORK_ERROR) (version 24.3.12.76.altinitystable) (from [::ffff:127.0.0.1]:44374) (comment: 01757_optimize_skip_unused_shards_limit.sql) (in query: SELECT `__table1`.`dummy` AS `dummy` FROM `system`.`one` AS `__table1` WHERE (`__table1`.`dummy` = 0) OR (`__table1`.`dummy` = 1)), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:169: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000134e8a44 7. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 8. /build/src/Server/TCPHandler.cpp:2216: DB::TCPHandler::sendData(DB::Block const&) @ 0x000000001d47d372 9. /build/src/Server/TCPHandler.cpp:1055: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d47af99 10. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d47005b 11. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 12. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 13. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 14. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 15. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 16. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 17. ? @ 0x00007f713a222ac3 18. ? @ 0x00007f713a2b4850 2024.12.16 10:58:41.933207 [ 2756 ] {c34b2cf6-7af8-47d9-93ee-5cf712156a5b} TCPHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:44374). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:169: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000134e8a44 7. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 8. /build/src/Server/TCPHandler.cpp:2216: DB::TCPHandler::sendData(DB::Block const&) @ 0x000000001d47d372 9. /build/src/Server/TCPHandler.cpp:1055: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d47af99 10. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d47005b 11. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 12. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 13. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 14. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 15. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 16. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 17. ? @ 0x00007f713a222ac3 18. ? @ 0x00007f713a2b4850 2024.12.16 10:58:41.937135 [ 2756 ] {c34b2cf6-7af8-47d9-93ee-5cf712156a5b} TCPHandler: Client has gone away. 2024.12.16 10:58:41.987668 [ 3096 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:58:42.503295 [ 6123 ] {f51cfc27-f340-4882-bfbc-4196868094b2} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=31, jobs=31). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:41944) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM system.processes WHERE query_id != queryID() AND current_database = currentDatabase() AND query LIKE '%-- 11317_tuple%'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:58:42.623409 [ 6123 ] {f51cfc27-f340-4882-bfbc-4196868094b2} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=31, jobs=31). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:58:42.998582 [ 3110 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:58:44.006303 [ 3122 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:58:44.700685 [ 3552 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:260: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf3a0a0 21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 (version 24.3.12.76.altinitystable) 2024.12.16 10:58:45.039332 [ 3129 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:58:46.051792 [ 3143 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:58:46.256259 [ 3855 ] {d96ad68e-3e04-41e0-81ee-bb050356eeed} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=31, jobs=2): While executing MergeTreeSelect(pool: ReadPoolInOrder, algorithm: InOrder). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:41918) (comment: 00034_aggregate_key_fixed_string.sql) (in query: SELECT toFixedString(substring(SearchPhrase, 1, 17), 17) AS k1, count() AS c FROM test.hits GROUP BY k1 ORDER BY c DESC, k1 LIMIT 10 ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1fc91 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1fb3b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1faf0 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1fab0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1fa3b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce216d1 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1f750 16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future> DB::scheduleFromThreadPoolUnsafe, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl>&, String const&, Priority) @ 0x000000001ce1f09c 17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1d6c3 18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl>*, unsigned long) @ 0x000000001ce1d5b3 19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6eeac 20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, void, void>(std::allocator&, DB::MergeTreeMarksLoader*, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6edb5 21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int>(std::allocator, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6ece3 22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], std::shared_ptr&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, void>(std::allocator const&, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6eb95 23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, void>(std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6e49b 24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&, std::function const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bed3 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bbdd 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bb9d 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bb5d 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bb28 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd6a7e 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd2efd 31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fd02d6 2024.12.16 10:58:46.499066 [ 4182 ] {46ff71f7-00e2-40b9-a09b-031c0dd6fe05} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=13, jobs=13). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:41968) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM system.processes WHERE query_id != queryID() AND current_database = currentDatabase() AND query LIKE '%-- 11317_tuple%'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:58:46.595258 [ 4182 ] {46ff71f7-00e2-40b9-a09b-031c0dd6fe05} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=13, jobs=13). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:58:47.068565 [ 3150 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:58:47.378122 [ 6123 ] {31fbf45d-8516-490b-9c34-0ef8c4902bdf} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=22, jobs=22). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:41974) (comment: 01083_window_view_select.sh) (in query: SELECT count(*) FROM wv), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:58:47.407076 [ 6123 ] {31fbf45d-8516-490b-9c34-0ef8c4902bdf} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=22, jobs=22). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:58:47.480709 [ 3855 ] {d96ad68e-3e04-41e0-81ee-bb050356eeed} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=31, jobs=2): While executing MergeTreeSelect(pool: ReadPoolInOrder, algorithm: InOrder). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1fc91 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1fb3b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1faf0 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1fab0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1fa3b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce216d1 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1f750 16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future> DB::scheduleFromThreadPoolUnsafe, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl>&, String const&, Priority) @ 0x000000001ce1f09c 17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1d6c3 18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl>*, unsigned long) @ 0x000000001ce1d5b3 19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6eeac 20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, void, void>(std::allocator&, DB::MergeTreeMarksLoader*, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6edb5 21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int>(std::allocator, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6ece3 22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], std::shared_ptr&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, void>(std::allocator const&, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6eb95 23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, void>(std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6e49b 24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&, std::function const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bed3 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bbdd 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bb9d 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bb5d 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bb28 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd6a7e 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd2efd 31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fd02d6 2024.12.16 10:58:48.075639 [ 3153 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:58:49.083471 [ 3168 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:58:50.146193 [ 3183 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:58:51.161785 [ 3179 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:58:52.176597 [ 3199 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:58:52.285684 [ 3855 ] {f0efec29-fd5c-431e-afa7-1c05d1cc2df3} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=35, jobs=32). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:59074) (comment: 01083_window_view_select.sh) (in query: SELECT count(*) FROM wv), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:58:52.314609 [ 3855 ] {f0efec29-fd5c-431e-afa7-1c05d1cc2df3} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=35, jobs=32). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:58:53.182646 [ 3212 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:58:54.165722 [ 3855 ] {e35f8468-fdfa-400c-ae1b-8ab1ba64bbdd} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=2, jobs=2). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:59092) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM system.processes WHERE query_id != queryID() AND current_database = currentDatabase() AND query LIKE '%-- 11317_tuple%'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:58:54.226321 [ 3222 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:58:54.229977 [ 3855 ] {e35f8468-fdfa-400c-ae1b-8ab1ba64bbdd} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=2, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:58:55.244143 [ 3236 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:58:56.075964 [ 6123 ] {3c784968-efb3-4579-af0f-9f58eed607a3} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=55): While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:59068) (comment: 00043_any_left_join.sql) (in query: SELECT EventDate, count() AS hits, any(visits) FROM test.hits ANY LEFT JOIN ( SELECT StartDate AS EventDate, sum(Sign) AS visits FROM test.visits GROUP BY EventDate ) USING EventDate GROUP BY EventDate ORDER BY hits DESC LIMIT 10 SETTINGS joined_subquery_requires_alias = 0;), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1fc91 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1fb3b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1faf0 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1fab0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1fa3b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce216d1 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1f750 16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future> DB::scheduleFromThreadPoolUnsafe, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl>&, String const&, Priority) @ 0x000000001ce1f09c 17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1d6c3 18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl>*, unsigned long) @ 0x000000001ce1d5b3 19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6eeac 20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, void, void>(std::allocator&, DB::MergeTreeMarksLoader*, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6edb5 21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int>(std::allocator, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6ece3 22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], std::shared_ptr&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, void>(std::allocator const&, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6eb95 23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, void>(std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6e49b 24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&, std::function const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bed3 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bbdd 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bb9d 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bb5d 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bb28 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd6a7e 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd2efd 31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fd02d6 2024.12.16 10:58:56.249512 [ 3241 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:58:57.120407 [ 3544 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:260: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf3a0a0 21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 (version 24.3.12.76.altinitystable) 2024.12.16 10:58:57.213471 [ 3855 ] {b6d490ab-7db2-4394-babf-e102859ba740} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=37, jobs=37). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:59096) (comment: 01083_window_view_select.sh) (in query: SELECT count(*) FROM wv), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:58:57.246660 [ 3855 ] {b6d490ab-7db2-4394-babf-e102859ba740} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=37, jobs=37). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:58:57.254462 [ 3257 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:58:57.508707 [ 6123 ] {3c784968-efb3-4579-af0f-9f58eed607a3} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=55): While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1fc91 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1fb3b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1faf0 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1fab0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1fa3b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce216d1 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1f750 16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future> DB::scheduleFromThreadPoolUnsafe, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl>&, String const&, Priority) @ 0x000000001ce1f09c 17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1d6c3 18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl>*, unsigned long) @ 0x000000001ce1d5b3 19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6eeac 20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, void, void>(std::allocator&, DB::MergeTreeMarksLoader*, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6edb5 21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int>(std::allocator, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6ece3 22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], std::shared_ptr&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, void>(std::allocator const&, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6eb95 23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, void>(std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6e49b 24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&, std::function const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bed3 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bbdd 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bb9d 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bb5d 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bb28 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd6a7e 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd2efd 31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fd02d6 2024.12.16 10:58:57.779759 [ 4182 ] {bdd4c592-6269-428d-a121-779569576740} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=5, jobs=3). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:59098) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM system.processes WHERE query_id != queryID() AND current_database = currentDatabase() AND query LIKE '%-- 11317_tuple%'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:58:57.856753 [ 4182 ] {bdd4c592-6269-428d-a121-779569576740} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=5, jobs=3). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:58:58.298375 [ 3268 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:58:59.313642 [ 3281 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:00.008815 [ 3547 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::TransactionsInfoLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:260: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf3a0a0 21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:00.321418 [ 3283 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:01.372746 [ 3292 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:01.754881 [ 3855 ] {80b8846f-3712-4e83-9921-33869e2bc2c0} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=18, jobs=18). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:56484) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM system.processes WHERE query_id != queryID() AND current_database = currentDatabase() AND query LIKE '%-- 11317_tuple%'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:59:01.929242 [ 3855 ] {80b8846f-3712-4e83-9921-33869e2bc2c0} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=18, jobs=18). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:59:02.390475 [ 3306 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:03.397682 [ 3320 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:04.405171 [ 3332 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:05.105842 [ 3478 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {fe54ed48-ddd9-4cf8-aa3b-418c81cf437c::202412_1_59_11}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:43: DB::MergeTreeDataPartWriterOnDisk::Stream::preFinalize() @ 0x000000001cce58f4 21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:644: DB::MergeTreeDataPartWriterWide::fillDataChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set, std::equal_to, std::allocator>&) @ 0x000000001ccf2d83 22. /build/src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set, std::equal_to, std::allocator>&) @ 0x000000001ccf327e 23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf3803a 24. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37f43 25. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb722bf 26. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb725d8 27. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb71fb2 28. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13ef38 29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x000000001cba15ed 30. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x000000001cba210e 31. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef, StrongTypedef, std::basic_string_view>)::'lambda'()::operator()() const @ 0x000000001cba9c78 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:05.423439 [ 3341 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:05.891811 [ 5023 ] {e2b247b3-efc1-4ba8-97cb-aaba66127abd} executeQuery: Code: 164. DB::Exception: default: Cannot execute query in readonly mode. (READONLY) (version 24.3.12.76.altinitystable) (from [::1]:56528) (comment: 02473_functions_in_readonly_mode.sh) (in query: SELECT * from format('TSV', '123')), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000a8efdf3 6. /build/src/Access/ContextAccess.cpp:546: auto bool DB::ContextAccess::checkAccessImplHelper(DB::AccessFlags) const::'lambda'(int, FormatStringHelperImpl::type...>, $T&&...)::operator()<>(int, FormatStringHelperImpl::type...>, $T&&...) const @ 0x0000000019574eca 7. /build/src/Access/ContextAccess.cpp:627: bool DB::ContextAccess::checkAccessImplHelper(DB::AccessFlags) const @ 0x000000001957295b 8. /build/src/Access/ContextAccess.cpp:651: bool DB::ContextAccess::checkAccessImpl(DB::AccessFlags const&) const @ 0x000000001953f182 9. /build/src/Access/ContextAccess.cpp:724: DB::ContextAccess::checkAccess(DB::AccessFlags const&) const @ 0x000000001953a5fd 10. /build/src/Interpreters/Context.cpp:1398: void DB::Context::checkAccessImpl(DB::AccessFlags const&) const @ 0x000000001a56ef56 11. /build/src/Interpreters/Context.cpp:1401: DB::Context::checkAccess(DB::AccessFlags const&) const @ 0x000000001a5447bd 12. /build/src/TableFunctions/ITableFunction.cpp:32: DB::ITableFunction::execute(std::shared_ptr const&, std::shared_ptr, String const&, DB::ColumnsDescription, bool, bool) const @ 0x00000000190c557a 13. /build/src/Interpreters/Context.cpp:2014: DB::Context::executeTableFunction(std::shared_ptr const&, std::shared_ptr const&) @ 0x000000001a54a048 14. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:7558: DB::(anonymous namespace)::QueryAnalyzer::resolveTableFunction(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, DB::(anonymous namespace)::QueryExpressionsAliasVisitor&, bool) @ 0x000000001b0a6229 15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:7917: DB::(anonymous namespace)::QueryAnalyzer::resolveQueryJoinTreeNode(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, DB::(anonymous namespace)::QueryExpressionsAliasVisitor&) @ 0x000000001b0aacb8 16. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8164: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09ccd6 17. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001b09af74 18. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr&, std::shared_ptr) @ 0x000000001b09ac33 19. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr) @ 0x000000001b08c3a6 20. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr const&, DB::SelectQueryOptions const&, std::shared_ptr const&, std::shared_ptr const&) @ 0x000000001b507dac 21. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x000000001b5069e6 22. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr const&, DB::SelectQueryOptions const&) @ 0x000000001b509db7 23. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50924c 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b5091fd 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b50919d 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b50915d 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b509125 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b428b1e 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b42409d 30. /build/src/Interpreters/InterpreterFactory.cpp:355: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000001b42372d 31. /build/src/Interpreters/executeQuery.cpp:1133: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb1cb0 2024.12.16 10:59:05.893770 [ 3868 ] {1f47a74b-19b7-4a70-90ea-bc6358bd02de} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=15, jobs=15). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:56522) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM system.processes WHERE query_id != queryID() AND current_database = currentDatabase() AND query LIKE '%-- 11317_tuple%'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:59:05.951011 [ 5023 ] {e2b247b3-efc1-4ba8-97cb-aaba66127abd} TCPHandler: Code: 164. DB::Exception: default: Cannot execute query in readonly mode. (READONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000a8efdf3 6. /build/src/Access/ContextAccess.cpp:546: auto bool DB::ContextAccess::checkAccessImplHelper(DB::AccessFlags) const::'lambda'(int, FormatStringHelperImpl::type...>, $T&&...)::operator()<>(int, FormatStringHelperImpl::type...>, $T&&...) const @ 0x0000000019574eca 7. /build/src/Access/ContextAccess.cpp:627: bool DB::ContextAccess::checkAccessImplHelper(DB::AccessFlags) const @ 0x000000001957295b 8. /build/src/Access/ContextAccess.cpp:651: bool DB::ContextAccess::checkAccessImpl(DB::AccessFlags const&) const @ 0x000000001953f182 9. /build/src/Access/ContextAccess.cpp:724: DB::ContextAccess::checkAccess(DB::AccessFlags const&) const @ 0x000000001953a5fd 10. /build/src/Interpreters/Context.cpp:1398: void DB::Context::checkAccessImpl(DB::AccessFlags const&) const @ 0x000000001a56ef56 11. /build/src/Interpreters/Context.cpp:1401: DB::Context::checkAccess(DB::AccessFlags const&) const @ 0x000000001a5447bd 12. /build/src/TableFunctions/ITableFunction.cpp:32: DB::ITableFunction::execute(std::shared_ptr const&, std::shared_ptr, String const&, DB::ColumnsDescription, bool, bool) const @ 0x00000000190c557a 13. /build/src/Interpreters/Context.cpp:2014: DB::Context::executeTableFunction(std::shared_ptr const&, std::shared_ptr const&) @ 0x000000001a54a048 14. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:7558: DB::(anonymous namespace)::QueryAnalyzer::resolveTableFunction(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, DB::(anonymous namespace)::QueryExpressionsAliasVisitor&, bool) @ 0x000000001b0a6229 15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:7917: DB::(anonymous namespace)::QueryAnalyzer::resolveQueryJoinTreeNode(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, DB::(anonymous namespace)::QueryExpressionsAliasVisitor&) @ 0x000000001b0aacb8 16. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8164: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09ccd6 17. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001b09af74 18. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr&, std::shared_ptr) @ 0x000000001b09ac33 19. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr) @ 0x000000001b08c3a6 20. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr const&, DB::SelectQueryOptions const&, std::shared_ptr const&, std::shared_ptr const&) @ 0x000000001b507dac 21. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x000000001b5069e6 22. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr const&, DB::SelectQueryOptions const&) @ 0x000000001b509db7 23. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50924c 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b5091fd 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b50919d 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b50915d 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b509125 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b428b1e 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b42409d 30. /build/src/Interpreters/InterpreterFactory.cpp:355: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000001b42372d 31. /build/src/Interpreters/executeQuery.cpp:1133: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb1cb0 2024.12.16 10:59:06.139230 [ 3868 ] {1f47a74b-19b7-4a70-90ea-bc6358bd02de} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=15, jobs=15). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:59:06.426073 [ 3352 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:07.437213 [ 3364 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:07.784912 [ 4402 ] {e7486cdc-6b17-4c65-8eda-975a5e581c83} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=12). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:56524) (comment: 03174_merge_join_bug.sql) (in query: SELECT * FROM xxxx_yyy AS a INNER JOIN xxxx_yyy AS b ON a.key = b.key_b ORDER BY a.key;), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:59:07.925909 [ 4402 ] {e7486cdc-6b17-4c65-8eda-975a5e581c83} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=12). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:59:08.055690 [ 3868 ] {748f455a-8dfb-4ebf-8e4f-f9b893fb95a5} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=24, jobs=10). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:56542) (comment: 01083_window_view_select.sh) (in query: SELECT count(*) FROM wv), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:59:08.087224 [ 3868 ] {748f455a-8dfb-4ebf-8e4f-f9b893fb95a5} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=24, jobs=10). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:59:08.447220 [ 3368 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:09.491908 [ 2872 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:10.516624 [ 2880 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:10.676828 [ 3868 ] {aa2ffdc2-b640-4f8a-8aae-a417d60726fc} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=7, jobs=7). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:42962) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM system.processes WHERE query_id != queryID() AND current_database = currentDatabase() AND query LIKE '%-- 11317_tuple%'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:59:10.732423 [ 3868 ] {aa2ffdc2-b640-4f8a-8aae-a417d60726fc} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=7, jobs=7). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:59:11.034303 [ 4402 ] {40a79d9e-3997-4b62-a4af-78f7d2064cbe} executeQuery: Code: 164. DB::Exception: default: Cannot execute query in readonly mode. (READONLY) (version 24.3.12.76.altinitystable) (from [::1]:42972) (comment: 02473_functions_in_readonly_mode.sh) (in query: INSERT INTO FUNCTION null('x String') (x) FORMAT TSV ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000a8efdf3 6. /build/src/Access/ContextAccess.cpp:546: auto bool DB::ContextAccess::checkAccessImplHelper(DB::AccessFlags) const::'lambda'(int, FormatStringHelperImpl::type...>, $T&&...)::operator()<>(int, FormatStringHelperImpl::type...>, $T&&...) const @ 0x0000000019574eca 7. /build/src/Access/ContextAccess.cpp:627: bool DB::ContextAccess::checkAccessImplHelper(DB::AccessFlags) const @ 0x000000001957295b 8. /build/src/Access/ContextAccess.cpp:651: bool DB::ContextAccess::checkAccessImpl(DB::AccessFlags const&) const @ 0x000000001953f182 9. /build/src/Access/ContextAccess.cpp:724: DB::ContextAccess::checkAccess(DB::AccessFlags const&) const @ 0x000000001953a5fd 10. /build/src/Interpreters/Context.cpp:1398: void DB::Context::checkAccessImpl(DB::AccessFlags const&) const @ 0x000000001a56ef56 11. /build/src/Interpreters/Context.cpp:1401: DB::Context::checkAccess(DB::AccessFlags const&) const @ 0x000000001a5447bd 12. /build/src/TableFunctions/ITableFunction.cpp:32: DB::ITableFunction::execute(std::shared_ptr const&, std::shared_ptr, String const&, DB::ColumnsDescription, bool, bool) const @ 0x00000000190c557a 13. /build/src/Interpreters/InterpreterInsertQuery.cpp:107: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x000000001b42939e 14. /build/src/Interpreters/InterpreterInsertQuery.cpp:406: DB::InterpreterInsertQuery::execute() @ 0x000000001b42bb84 15. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 16. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 17. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 18. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 19. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 20. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 21. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 22. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 23. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 24. ? @ 0x00007f713a222ac3 25. ? @ 0x00007f713a2b4850 2024.12.16 10:59:11.079976 [ 4402 ] {40a79d9e-3997-4b62-a4af-78f7d2064cbe} TCPHandler: Code: 164. DB::Exception: default: Cannot execute query in readonly mode. (READONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000a8efdf3 6. /build/src/Access/ContextAccess.cpp:546: auto bool DB::ContextAccess::checkAccessImplHelper(DB::AccessFlags) const::'lambda'(int, FormatStringHelperImpl::type...>, $T&&...)::operator()<>(int, FormatStringHelperImpl::type...>, $T&&...) const @ 0x0000000019574eca 7. /build/src/Access/ContextAccess.cpp:627: bool DB::ContextAccess::checkAccessImplHelper(DB::AccessFlags) const @ 0x000000001957295b 8. /build/src/Access/ContextAccess.cpp:651: bool DB::ContextAccess::checkAccessImpl(DB::AccessFlags const&) const @ 0x000000001953f182 9. /build/src/Access/ContextAccess.cpp:724: DB::ContextAccess::checkAccess(DB::AccessFlags const&) const @ 0x000000001953a5fd 10. /build/src/Interpreters/Context.cpp:1398: void DB::Context::checkAccessImpl(DB::AccessFlags const&) const @ 0x000000001a56ef56 11. /build/src/Interpreters/Context.cpp:1401: DB::Context::checkAccess(DB::AccessFlags const&) const @ 0x000000001a5447bd 12. /build/src/TableFunctions/ITableFunction.cpp:32: DB::ITableFunction::execute(std::shared_ptr const&, std::shared_ptr, String const&, DB::ColumnsDescription, bool, bool) const @ 0x00000000190c557a 13. /build/src/Interpreters/InterpreterInsertQuery.cpp:107: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x000000001b42939e 14. /build/src/Interpreters/InterpreterInsertQuery.cpp:406: DB::InterpreterInsertQuery::execute() @ 0x000000001b42bb84 15. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 16. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 17. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 18. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 19. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 20. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 21. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 22. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 23. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 24. ? @ 0x00007f713a222ac3 25. ? @ 0x00007f713a2b4850 2024.12.16 10:59:11.547998 [ 2892 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:11.913628 [ 3568 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::TraceLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:286: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf3a6fb 21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:12.561967 [ 2909 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:13.415046 [ 3487 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {3fad45aa-c6fd-41ee-8fe5-5d48f1e42f6c::202412_1_46_9}: Code: 241. DB::Exception: Memory tracker (for thread): fault injected (at specific point). (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, char const*&&) @ 0x00000000132eab6c 6. /build/src/Common/MemoryTracker.cpp:184: MemoryTracker::injectFault() const @ 0x00000000132e7f5f 7. /build/src/Common/CurrentMemoryTracker.cpp:129: CurrentMemoryTracker::injectFault() @ 0x0000000013256b05 8. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:149: DB::MergePlainMergeTreeTask::finish() @ 0x000000001d13f918 9. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:71: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13f076 10. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x000000001cba15ed 11. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x000000001cba210e 12. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef, StrongTypedef, std::basic_string_view>)::'lambda'()::operator()() const @ 0x000000001cba9c78 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba9c55 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001cba9c35 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001cba9c15 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001cba9bdd 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:13.583776 [ 2921 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:13.625327 [ 3544 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:298: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd2eaf 21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set, std::equal_to, std::allocator>&) @ 0x000000001ccd371a 22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf3803a 23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d (version 24.3.12.76.altinitystable) 2024.12.16 10:59:14.683390 [ 2933 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:15.688357 [ 2944 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:16.697551 [ 2956 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:17.699737 [ 2958 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:18.351579 [ 3487 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {fe54ed48-ddd9-4cf8-aa3b-418c81cf437c::202412_1_60_11}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:43: DB::MergeTreeDataPartWriterOnDisk::Stream::preFinalize() @ 0x000000001cce58f4 21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:644: DB::MergeTreeDataPartWriterWide::fillDataChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set, std::equal_to, std::allocator>&) @ 0x000000001ccf2d83 22. /build/src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set, std::equal_to, std::allocator>&) @ 0x000000001ccf327e 23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf3803a 24. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37f43 25. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb722bf 26. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb725d8 27. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb71fb2 28. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13ef38 29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x000000001cba15ed 30. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x000000001cba210e 31. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef, StrongTypedef, std::basic_string_view>)::'lambda'()::operator()() const @ 0x000000001cba9c78 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:18.674388 [ 4402 ] {09730e70-312e-4901-bc1a-f92f4fb51245} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=8, jobs=8). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:43016) (comment: 01083_window_view_select.sh) (in query: SELECT count(*) FROM wv), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:59:18.686766 [ 4402 ] {09730e70-312e-4901-bc1a-f92f4fb51245} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=8, jobs=8). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:59:18.706768 [ 2972 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:19.718613 [ 2987 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:20.183099 [ 3553 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:260: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf3a0a0 21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:20.217108 [ 4402 ] {c52493e4-55d9-4fa1-8a8d-67c6314373b6} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=932, jobs=888). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::ffff:127.0.0.1]:60154) (comment: 03174_low_cardinality_group_by_distributed_plan.sql) (in query: SELECT 6 AS `6`, concat(' World', _CAST('6', 'UInt128'), 6, 6, 6, _CAST(6, 'Nullable(UInt8)'), materialize(_CAST('6', 'LowCardinality(Nullable(UInt128))'))) AS `a`, concat(concat(' World', 6, _CAST(6, 'LowCardinality(UInt8)'), ' World', _CAST('6', 'UInt256'), materialize(6), 6, _CAST(6, 'Nullable(UInt8)'), 6, 6, _CAST(NULL, 'Nullable(Nothing)'), 6, 6), ' World', 6, 6, 6, 6, _CAST('6', 'UInt256'), _CAST(NULL, 'Nullable(Nothing)'), 6, 6) AS `b` FROM `system`.`one` AS `__table1` GROUP BY _CAST(6, 'Nullable(UInt8)') WITH ROLLUP WITH TOTALS), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133dc4ad 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d4458 8. /build/src/Common/ThreadPool.cpp:338: ThreadPoolImpl::scheduleOrThrow(std::function, Priority, unsigned long, bool) @ 0x00000000133d4d10 9. /build/src/Common/ThreadPool.h:205: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001d538cf3 10. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:112: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long) @ 0x000000001d538a34 11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:138: DB::PullingAsyncPipelineExecutor::pull(DB::Block&, unsigned long) @ 0x000000001d538de9 12. /build/src/Server/TCPHandler.cpp:1023: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d47ad7f 13. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d47005b 14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 20. ? @ 0x00007f713a222ac3 21. ? @ 0x00007f713a2b4850 2024.12.16 10:59:20.271567 [ 4402 ] {c52493e4-55d9-4fa1-8a8d-67c6314373b6} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=932, jobs=888). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133dc4ad 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d4458 8. /build/src/Common/ThreadPool.cpp:338: ThreadPoolImpl::scheduleOrThrow(std::function, Priority, unsigned long, bool) @ 0x00000000133d4d10 9. /build/src/Common/ThreadPool.h:205: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001d538cf3 10. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:112: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long) @ 0x000000001d538a34 11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:138: DB::PullingAsyncPipelineExecutor::pull(DB::Block&, unsigned long) @ 0x000000001d538de9 12. /build/src/Server/TCPHandler.cpp:1023: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d47ad7f 13. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d47005b 14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 20. ? @ 0x00007f713a222ac3 21. ? @ 0x00007f713a2b4850 2024.12.16 10:59:20.296893 [ 5023 ] {57c963c0-bde4-495c-afd4-1c7e9c110d92} executeQuery: Code: 439. DB::Exception: Received from 127.0.0.1:9000. DB::Exception: Cannot schedule a task: fault injected (threads=932, jobs=888). Stack trace: 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133dc4ad 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d4458 8. /build/src/Common/ThreadPool.cpp:338: ThreadPoolImpl::scheduleOrThrow(std::function, Priority, unsigned long, bool) @ 0x00000000133d4d10 9. /build/src/Common/ThreadPool.h:205: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001d538cf3 10. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:112: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long) @ 0x000000001d538a34 11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:138: DB::PullingAsyncPipelineExecutor::pull(DB::Block&, unsigned long) @ 0x000000001d538de9 12. /build/src/Server/TCPHandler.cpp:1023: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d47ad7f 13. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d47005b 14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 20. ? @ 0x00007f713a222ac3 21. ? @ 0x00007f713a2b4850 : While executing Remote. (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:42986) (comment: 03174_low_cardinality_group_by_distributed_plan.sql) (in query: SELECT 6, concat(' World', toUInt128(6), 6, 6, 6, toNullable(6), materialize(toLowCardinality(toNullable(toUInt128(6))))) AS a, concat(concat(' World', 6, toLowCardinality(6), ' World', toUInt256(6), materialize(6), 6, toNullable(6), 6, 6, NULL, 6, 6), ' World', 6, 6, 6, 6, toUInt256(6), NULL, 6, 6) AS b FROM remote('127.0.0.1') GROUP BY toNullable(6) WITH ROLLUP WITH TOTALS;), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:89: DB::Exception::Exception(String const&, int, bool) @ 0x000000000a942caa 5. /build/src/Common/Exception.h:97: DB::Exception::createDeprecated(String const&, int, bool) @ 0x000000000a942c55 6. /build/src/IO/ReadHelpers.cpp:1560: DB::readException(DB::ReadBuffer&, String const&, bool) @ 0x0000000013369f82 7. /build/src/Client/Connection.cpp:1233: DB::Connection::receiveException() const @ 0x000000001d2bdc59 8. /build/src/Client/Connection.cpp:1070: DB::Connection::receivePacket() @ 0x000000001d2c51b1 9. /build/src/Client/PacketReceiver.cpp:66: DB::PacketReceiver::Task::run(std::function, std::function) @ 0x000000001d3320a4 10. /build/src/Common/AsyncTaskExecutor.cpp:88: DB::AsyncTaskExecutor::Routine::operator()(std::function) @ 0x0000000019ebde69 11. /build/src/Common/Fiber.h:76: Fiber::RoutineImpl::operator()(boost::context::fiber&&) @ 0x0000000019ebdd78 12. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019ebdd08 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:531: ? @ 0x0000000019ebdcc8 14. /build/contrib/boost/boost/context/fiber_fcontext.hpp:157: boost::context::detail::fiber_record>::run(void*) @ 0x0000000019ebdbfe 15. /build/contrib/boost/boost/context/fiber_fcontext.hpp:97: void boost::context::detail::fiber_entry>>(boost::context::detail::transfer_t) @ 0x0000000019ebd91d 2024.12.16 10:59:20.325275 [ 5023 ] {57c963c0-bde4-495c-afd4-1c7e9c110d92} TCPHandler: Code: 439. DB::Exception: Received from 127.0.0.1:9000. DB::Exception: Cannot schedule a task: fault injected (threads=932, jobs=888). Stack trace: 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133dc4ad 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d4458 8. /build/src/Common/ThreadPool.cpp:338: ThreadPoolImpl::scheduleOrThrow(std::function, Priority, unsigned long, bool) @ 0x00000000133d4d10 9. /build/src/Common/ThreadPool.h:205: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001d538cf3 10. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:112: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long) @ 0x000000001d538a34 11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:138: DB::PullingAsyncPipelineExecutor::pull(DB::Block&, unsigned long) @ 0x000000001d538de9 12. /build/src/Server/TCPHandler.cpp:1023: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d47ad7f 13. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d47005b 14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 20. ? @ 0x00007f713a222ac3 21. ? @ 0x00007f713a2b4850 : While executing Remote. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:89: DB::Exception::Exception(String const&, int, bool) @ 0x000000000a942caa 5. /build/src/Common/Exception.h:97: DB::Exception::createDeprecated(String const&, int, bool) @ 0x000000000a942c55 6. /build/src/IO/ReadHelpers.cpp:1560: DB::readException(DB::ReadBuffer&, String const&, bool) @ 0x0000000013369f82 7. /build/src/Client/Connection.cpp:1233: DB::Connection::receiveException() const @ 0x000000001d2bdc59 8. /build/src/Client/Connection.cpp:1070: DB::Connection::receivePacket() @ 0x000000001d2c51b1 9. /build/src/Client/PacketReceiver.cpp:66: DB::PacketReceiver::Task::run(std::function, std::function) @ 0x000000001d3320a4 10. /build/src/Common/AsyncTaskExecutor.cpp:88: DB::AsyncTaskExecutor::Routine::operator()(std::function) @ 0x0000000019ebde69 11. /build/src/Common/Fiber.h:76: Fiber::RoutineImpl::operator()(boost::context::fiber&&) @ 0x0000000019ebdd78 12. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019ebdd08 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:531: ? @ 0x0000000019ebdcc8 14. /build/contrib/boost/boost/context/fiber_fcontext.hpp:157: boost::context::detail::fiber_record>::run(void*) @ 0x0000000019ebdbfe 15. /build/contrib/boost/boost/context/fiber_fcontext.hpp:97: void boost::context::detail::fiber_entry>>(boost::context::detail::transfer_t) @ 0x0000000019ebd91d 2024.12.16 10:59:20.739760 [ 3004 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:21.748686 [ 3018 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:22.764385 [ 3024 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:23.770658 [ 3026 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:24.041059 [ 4402 ] {d6a74181-a606-45cf-8a44-a3f1100c9ed1} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=2, jobs=2). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:52912) (comment: 01083_window_view_select.sh) (in query: SELECT count(*) FROM wv), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:59:24.073190 [ 4402 ] {d6a74181-a606-45cf-8a44-a3f1100c9ed1} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=2, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:59:24.777568 [ 3052 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:25.785466 [ 3067 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:26.387735 [ 3552 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:296: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd2e93 21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set, std::equal_to, std::allocator>&) @ 0x000000001ccd371a 22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf3803a 23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d (version 24.3.12.76.altinitystable) 2024.12.16 10:59:26.805520 [ 3076 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:28.100138 [ 4402 ] {81c1c998-b69c-4d6c-b3ba-b13c1a8f7377} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=1). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:52928) (comment: 03174_split_parts_ranges_into_intersecting_and_non_intersecting_final_and_read-in-order_bug.sql) (in query: insert into tab select toDateTime('2000-01-01', 'UTC') + number, number, 1 from numbers(1e7);), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:45: DB::MergeTreeDataPartWriterOnDisk::Stream::preFinalize() @ 0x000000001cce590d 21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:644: DB::MergeTreeDataPartWriterWide::fillDataChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set, std::equal_to, std::allocator>&) @ 0x000000001ccf2d83 22. /build/src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set, std::equal_to, std::allocator>&) @ 0x000000001ccf327e 23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf3803a 24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 26. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 2024.12.16 10:59:28.100526 [ 2917 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:28.148345 [ 4402 ] {81c1c998-b69c-4d6c-b3ba-b13c1a8f7377} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:45: DB::MergeTreeDataPartWriterOnDisk::Stream::preFinalize() @ 0x000000001cce590d 21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:644: DB::MergeTreeDataPartWriterWide::fillDataChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set, std::equal_to, std::allocator>&) @ 0x000000001ccf2d83 22. /build/src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set, std::equal_to, std::allocator>&) @ 0x000000001ccf327e 23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf3803a 24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 26. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 2024.12.16 10:59:28.915647 [ 2756 ] {7000f78d-490b-4d42-bec1-69ff053e6374} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=24, jobs=24). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:47380) (comment: 01083_window_view_select.sh) (in query: SELECT count(*) FROM wv), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:59:28.939109 [ 2756 ] {7000f78d-490b-4d42-bec1-69ff053e6374} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=24, jobs=24). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:59:29.113057 [ 3021 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:30.127695 [ 3086 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:31.137248 [ 3106 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:32.142551 [ 3105 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:33.149353 [ 3111 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:33.525926 [ 2758 ] {0c4c8d01-b51f-4a3f-922b-61a8dd379f65} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:47410) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM system.processes WHERE query_id != queryID() AND current_database = currentDatabase() AND query LIKE '%-- 11317_tuple%'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:59:33.870531 [ 2758 ] {0c4c8d01-b51f-4a3f-922b-61a8dd379f65} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:59:34.151361 [ 3129 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:35.165767 [ 3136 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:36.175756 [ 3121 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:37.199934 [ 3161 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:38.208338 [ 3174 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:39.009108 [ 3751 ] {767f22e6-dcea-4a20-be78-748c08f6e6b3} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=28, jobs=28). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:42970) (comment: 01083_window_view_select.sh) (in query: SELECT count(*) FROM wv), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:59:39.028500 [ 3751 ] {767f22e6-dcea-4a20-be78-748c08f6e6b3} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=28, jobs=28). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:59:39.298194 [ 3185 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:40.302603 [ 3199 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:40.799460 [ 2756 ] {01391a2b-706a-46b6-9617-4bb9a065d5cf} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=8, jobs=1). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:42982) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM system.processes WHERE query_id != queryID() AND current_database = currentDatabase() AND query LIKE '%-- 11317_tuple%'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:59:40.856563 [ 2756 ] {01391a2b-706a-46b6-9617-4bb9a065d5cf} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=8, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:59:41.023332 [ 3492 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {3874c721-a658-4698-80d5-52c26fc35278::202412_1_51_10}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:294: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf3a8b6 21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37f43 23. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb722bf 24. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb725d8 25. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb71fb2 26. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13ef38 27. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x000000001cba15ed 28. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x000000001cba210e 29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef, StrongTypedef, std::basic_string_view>)::'lambda'()::operator()() const @ 0x000000001cba9c78 30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba9c55 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001cba9c35 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:41.305131 [ 3212 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:42.330400 [ 3231 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:42.472223 [ 3552 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:442: DB::MergeTreeDataPartWriterOnDisk::fillPrimaryIndexChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001cce38ba 21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set, std::equal_to, std::allocator>&) @ 0x000000001ccd3738 22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf3803a 23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d (version 24.3.12.76.altinitystable) 2024.12.16 10:59:43.339914 [ 3248 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:44.119070 [ 3855 ] {70b6b63e-6989-498a-b07d-481d5dc8a9a4} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=51): While executing MergeTreeSelect(pool: ReadPoolInOrder, algorithm: InOrder). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::ffff:127.0.0.1]:60732) (comment: 00159_parallel_formatting_http.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a,MobilePhoneModel as b,ClientIP6 as c FROM test.hits ORDER BY a,b,c LIMIT 1000000 Format TSV ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1fc91 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1fb3b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1faf0 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1fab0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1fa3b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce216d1 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1f750 16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future> DB::scheduleFromThreadPoolUnsafe, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl>&, String const&, Priority) @ 0x000000001ce1f09c 17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1d6c3 18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl>*, unsigned long) @ 0x000000001ce1d5b3 19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6eeac 20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, void, void>(std::allocator&, DB::MergeTreeMarksLoader*, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6edb5 21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int>(std::allocator, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6ece3 22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], std::shared_ptr&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, void>(std::allocator const&, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6eb95 23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, void>(std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6e49b 24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&, std::function const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bed3 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bbdd 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bb9d 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bb5d 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bb28 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd6a7e 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd2efd 31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fd02d6 2024.12.16 10:59:44.342794 [ 3177 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:44.525906 [ 3751 ] {da7ec061-2a0a-4189-a6e1-a854d7d624a1} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=7, jobs=7). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:42978) (comment: 00617_array_in.sql) (in query: SELECT count(*) FROM test_array_ops where arr = CAST([10, -20] AS Array(Nullable(Int64)));), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:59:44.557512 [ 3751 ] {da7ec061-2a0a-4189-a6e1-a854d7d624a1} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=7, jobs=7). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:59:44.906349 [ 4182 ] {460d324f-8764-4e52-af63-6a4ee4945b44} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=6, jobs=6). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:43004) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM system.processes WHERE query_id != queryID() AND current_database = currentDatabase() AND query LIKE '%-- 11317_tuple%'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:59:44.957803 [ 4182 ] {460d324f-8764-4e52-af63-6a4ee4945b44} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=6, jobs=6). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 10:59:44.978351 [ 3484 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {3874c721-a658-4698-80d5-52c26fc35278::202412_1_51_10}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergeTreePartition.cpp:441: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000001ce2fec6 21. /build/src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001ce2f078 22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:239: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39bb5 23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 24. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37f43 25. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb722bf 26. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb725d8 27. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb71fb2 28. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13ef38 29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x000000001cba15ed 30. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x000000001cba210e 31. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef, StrongTypedef, std::basic_string_view>)::'lambda'()::operator()() const @ 0x000000001cba9c78 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:45.009051 [ 5021 ] {4dccc6a3-72ac-444d-998c-cb97b119025a} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=1). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:42990) (comment: 03169_optimize_injective_functions_inside_uniq_crash.sql) (in query: SELECT sum(u) FROM ( SELECT intDiv(number, 4096) AS k, uniqCombined(tuple(materialize(toLowCardinality(toNullable(16))))) AS u FROM numbers(4096 * 100) GROUP BY k ) SETTINGS allow_experimental_analyzer = 1, optimize_injective_functions_inside_uniq=1;), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:59:45.197276 [ 5021 ] {4dccc6a3-72ac-444d-998c-cb97b119025a} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 10:59:45.428421 [ 3269 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:46.436960 [ 3282 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:47.097131 [ 3486 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {a1d2c310-018e-47c7-a0f2-837bf40ba898::202412_1_45_9}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1fc91 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1fb3b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1faf0 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1fab0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1fa3b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce216d1 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1f750 16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future> DB::scheduleFromThreadPoolUnsafe, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl>&, String const&, Priority) @ 0x000000001ce1f09c 17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1d6c3 18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl>*, unsigned long) @ 0x000000001ce1d5b3 19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*, unsigned long, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&&, unsigned long&&) @ 0x000000001ce56a2c 20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*, unsigned long, void, void>(std::allocator&, DB::MergeTreeMarksLoader*, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&&, unsigned long&&) @ 0x000000001ce56935 21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*, unsigned long>(std::allocator, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&&, unsigned long&&) @ 0x000000001ce56863 22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], std::shared_ptr&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*, unsigned long, void>(std::allocator const&, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&&, unsigned long&&) @ 0x000000001ce56715 23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*, unsigned long, void>(std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&&, unsigned long&&) @ 0x000000001ce53cbb 24. /build/src/Storages/MergeTree/MergeTreeReaderCompact.cpp:37: DB::MergeTreeReaderCompact::MergeTreeReaderCompact(std::shared_ptr, DB::NamesAndTypesList, std::unordered_map, std::equal_to, std::allocator>> const&, std::shared_ptr const&, DB::UncompressedCache*, DB::MarkCache*, DB::MarkRanges, DB::MergeTreeReaderSettings, std::map, std::allocator>>, std::function const&, int) @ 0x000000001ce51f0a 25. /build/src/Storages/MergeTree/MergeTreeReaderCompactSingleBuffer.h:16: DB::MergeTreeReaderCompactSingleBuffer::MergeTreeReaderCompactSingleBuffer&, DB::NamesAndTypesList const&, std::unordered_map, std::equal_to, std::allocator>> const&, std::shared_ptr const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map, std::allocator>> const&, std::function const&, int>(std::shared_ptr&, DB::NamesAndTypesList const&, std::unordered_map, std::equal_to, std::allocator>> const&, std::shared_ptr const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map, std::allocator>> const&, std::function const&, int&&) @ 0x000000001ccc27a5 26. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, DB::NamesAndTypesList const&, std::unordered_map, std::equal_to, std::allocator>> const&, std::shared_ptr const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map, std::allocator>> const&, std::function const&, int>(std::shared_ptr&, DB::NamesAndTypesList const&, std::unordered_map, std::equal_to, std::allocator>> const&, std::shared_ptr const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map, std::allocator>> const&, std::function const&, int&&) @ 0x000000001ccc1b7d 27. /build/src/Storages/MergeTree/MergeTreeDataPartCompact.cpp:43: DB::MergeTreeDataPartCompact::getReader(DB::NamesAndTypesList const&, std::shared_ptr const&, DB::MarkRanges const&, std::unordered_map, std::equal_to, std::allocator>> const&, DB::UncompressedCache*, DB::MarkCache*, std::shared_ptr const&, DB::MergeTreeReaderSettings const&, std::map, std::allocator>> const&, std::function const&) const @ 0x000000001ccbeef3 28. /build/src/Storages/MergeTree/MergeTreeSequentialSource.cpp:177: DB::MergeTreeSequentialSource::MergeTreeSequentialSource(DB::MergeTreeSequentialSourceType, DB::MergeTreeData const&, std::shared_ptr const&, std::shared_ptr, std::vector>, std::optional, bool, bool, bool, bool) @ 0x000000001ce71ef0 29. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeSequentialSource* std::construct_at[abi:v15000] const&, std::shared_ptr&, std::vector>&, std::optional, bool, bool&, bool&, bool&, DB::MergeTreeSequentialSource*>(DB::MergeTreeSequentialSource*, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr const&, std::shared_ptr&, std::vector>&, std::optional&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce76047 30. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000] const&, std::shared_ptr&, std::vector>&, std::optional, bool, bool&, bool&, bool&, void, void>(std::allocator&, DB::MergeTreeSequentialSource*, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr const&, std::shared_ptr&, std::vector>&, std::optional&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce75d04 31. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000] const&, std::shared_ptr&, std::vector>&, std::optional, bool, bool&, bool&, bool&>(std::allocator, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr const&, std::shared_ptr&, std::vector>&, std::optional&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce759b1 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:47.446640 [ 3295 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:48.405031 [ 3481 ] {41d82839-5472-4425-b891-a2dc2a236577::201403_1_6_1} WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key s3/uwf/gntlzoapwblfhfcjzmpakhcsrlyxh, total size 67108864, count 67108864, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 9e8fbadb-5e29-4942-be26-4be0f2dfb36b, upload has finished false. 2024.12.16 10:59:48.411654 [ 3481 ] {41d82839-5472-4425-b891-a2dc2a236577::201403_1_6_1} WriteBufferFromS3: Abort multipart upload. Details: bucket test, key s3/uwf/gntlzoapwblfhfcjzmpakhcsrlyxh, total size 67108864, count 67108864, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 9e8fbadb-5e29-4942-be26-4be0f2dfb36b, upload has finished false 2024.12.16 10:59:48.452376 [ 3314 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:48.453768 [ 3481 ] {41d82839-5472-4425-b891-a2dc2a236577::201403_1_6_1} WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key s3/uwf/gntlzoapwblfhfcjzmpakhcsrlyxh, total size 67108864, count 67108864, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 9e8fbadb-5e29-4942-be26-4be0f2dfb36b, upload has finished false 2024.12.16 10:59:48.868528 [ 3481 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {41d82839-5472-4425-b891-a2dc2a236577::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=40, jobs=0): (while reading column Referer): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/41d/41d82839-5472-4425-b891-a2dc2a236577/201403_4_4_0/ in table test.visits (41d82839-5472-4425-b891-a2dc2a236577) located on disk s3_disk of type s3, from mark 17 with max_rows_to_read = 6741): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe(ThreadPoolImpl>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e92e1 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e917b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e9130 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e90f0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e907b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190eadb1 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e8d90 16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future DB::scheduleFromThreadPoolUnsafe(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl>&, String const&, Priority) @ 0x00000000190e861c 17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e7e3f 18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019365312 19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936561e 20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddc44d 21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6d168 22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6cfbd 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6cf7d 24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6cf3d 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6cf08 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd6a7e 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd2efd 28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fd02d6 29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x0000000019fd045c 30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&) @ 0x000000001ce6ab9b 31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce6a910 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:49.461053 [ 3325 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:50.551280 [ 3339 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:50.624224 [ 3552 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:294: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf3a8b6 21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:51.561597 [ 3359 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:52.510618 [ 3855 ] {70b6b63e-6989-498a-b07d-481d5dc8a9a4} DynamicQueryHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=51): While executing MergeTreeSelect(pool: ReadPoolInOrder, algorithm: InOrder). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1fc91 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1fb3b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1faf0 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1fab0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1fa3b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce216d1 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1f750 16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future> DB::scheduleFromThreadPoolUnsafe, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl>&, String const&, Priority) @ 0x000000001ce1f09c 17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1d6c3 18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl>*, unsigned long) @ 0x000000001ce1d5b3 19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6eeac 20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, void, void>(std::allocator&, DB::MergeTreeMarksLoader*, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6edb5 21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int>(std::allocator, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6ece3 22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], std::shared_ptr&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, void>(std::allocator const&, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6eb95 23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, void>(std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6e49b 24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&, std::function const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bed3 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bbdd 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bb9d 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bb5d 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bb28 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd6a7e 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd2efd 31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fd02d6 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:52.559100 [ 3478 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {a1d2c310-018e-47c7-a0f2-837bf40ba898::202412_1_45_9}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:298: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd2eaf 21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set, std::equal_to, std::allocator>&) @ 0x000000001ccd371a 22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf3803a 23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37f43 24. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb722bf 25. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb725d8 26. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb71fb2 27. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13ef38 28. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x000000001cba15ed 29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x000000001cba210e 30. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef, StrongTypedef, std::basic_string_view>)::'lambda'()::operator()() const @ 0x000000001cba9c78 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba9c55 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:52.570632 [ 3375 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:53.572793 [ 2872 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:53.796508 [ 3488 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {41d82839-5472-4425-b891-a2dc2a236577::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=40, jobs=2): (while reading column Sign): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/41d/41d82839-5472-4425-b891-a2dc2a236577/201403_3_3_0/ in table test.visits (41d82839-5472-4425-b891-a2dc2a236577) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 6608): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe(ThreadPoolImpl>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e92e1 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e917b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e9130 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e90f0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e907b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190eadb1 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e8d90 16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future DB::scheduleFromThreadPoolUnsafe(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl>&, String const&, Priority) @ 0x00000000190e861c 17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e7e3f 18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019365312 19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936561e 20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddc44d 21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6d168 22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6cfbd 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6cf7d 24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6cf3d 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6cf08 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd6a7e 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd2efd 28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fd02d6 29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x0000000019fd045c 30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&) @ 0x000000001ce6ab9b 31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce6a910 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:54.397132 [ 3549 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::TextLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:442: DB::MergeTreeDataPartWriterOnDisk::fillPrimaryIndexChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001cce38ba 21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set, std::equal_to, std::allocator>&) @ 0x000000001ccd3738 22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf3803a 23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d (version 24.3.12.76.altinitystable) 2024.12.16 10:59:54.581903 [ 2885 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:55.594619 [ 2895 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:55.761179 [ 3492 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {fe54ed48-ddd9-4cf8-aa3b-418c81cf437c::202412_1_67_11}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:442: DB::MergeTreeDataPartWriterOnDisk::fillPrimaryIndexChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001cce38ba 21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set, std::equal_to, std::allocator>&) @ 0x000000001ccf329c 22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf3803a 23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37f43 24. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb722bf 25. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb725d8 26. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb71fb2 27. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13ef38 28. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x000000001cba15ed 29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x000000001cba210e 30. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef, StrongTypedef, std::basic_string_view>)::'lambda'()::operator()() const @ 0x000000001cba9c78 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba9c55 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:56.599068 [ 2868 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:57.608355 [ 2911 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:58.051515 [ 3568 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::TraceLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergeTreePartition.cpp:441: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000001ce2fec6 21. /build/src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001ce2f078 22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:239: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39bb5 23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 26. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:58.628070 [ 2942 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 10:59:59.699812 [ 2936 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:00.036566 [ 3868 ] {89f62e5b-e530-4cd7-9b0d-24350f4de277} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=34, jobs=34). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:50116) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM system.processes WHERE query_id != queryID() AND current_database = currentDatabase() AND query LIKE '%-- 11317_tuple%'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 11:00:00.166429 [ 3868 ] {89f62e5b-e530-4cd7-9b0d-24350f4de277} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=34, jobs=34). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 11:00:00.744632 [ 2970 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:01.758563 [ 4182 ] {} Access(user directories): from: ::ffff:127.0.0.1, user: default: Authentication failed: Code: 193. DB::Exception: Invalid credentials. (WRONG_PASSWORD), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f4eb7 6. /build/src/Access/IAccessStorage.cpp:763: DB::IAccessStorage::throwInvalidCredentials() @ 0x000000001962d15b 7. /build/src/Access/IAccessStorage.cpp:537: DB::IAccessStorage::authenticateImpl(DB::Credentials const&, Poco::Net::IPAddress const&, DB::ExternalAuthenticators const&, bool, bool, bool) const @ 0x000000001962ce1d 8. /build/src/Access/IAccessStorage.cpp:511: DB::IAccessStorage::authenticate(DB::Credentials const&, Poco::Net::IPAddress const&, DB::ExternalAuthenticators const&, bool, bool, bool) const @ 0x000000001962cbd3 9. /build/src/Access/MultipleAccessStorage.cpp:451: DB::MultipleAccessStorage::authenticateImpl(DB::Credentials const&, Poco::Net::IPAddress const&, DB::ExternalAuthenticators const&, bool, bool, bool) const @ 0x00000000196c148a 10. /build/src/Access/IAccessStorage.cpp:499: DB::IAccessStorage::authenticate(DB::Credentials const&, Poco::Net::IPAddress const&, DB::ExternalAuthenticators const&, bool, bool) const @ 0x000000001962cb08 11. /build/src/Access/AccessControl.cpp:600: DB::AccessControl::authenticate(DB::Credentials const&, Poco::Net::IPAddress const&, String const&) const @ 0x00000000194d065a 12. /build/src/Interpreters/Session.cpp:352: DB::Session::authenticate(DB::Credentials const&, Poco::Net::SocketAddress const&) @ 0x000000001b8b2b47 13. /build/src/Interpreters/Session.cpp:332: DB::Session::authenticate(String const&, String const&, Poco::Net::SocketAddress const&) @ 0x000000001b8b1e49 14. /build/src/Server/TCPHandler.cpp:1532: DB::TCPHandler::receiveHello() @ 0x000000001d478a8f 15. /build/src/Server/TCPHandler.cpp:271: DB::TCPHandler::runImpl() @ 0x000000001d46cd2a 16. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 17. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 18. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 19. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 20. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 21. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 22. ? @ 0x00007f713a222ac3 23. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:01.759512 [ 2991 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:02.067915 [ 4182 ] {} ServerErrorHandler: Code: 516. DB::Exception: default: Authentication failed: password is incorrect, or there is no user with such name. If you have installed ClickHouse and forgot password you can reset it in the configuration file. The password for default user is typically located at /etc/clickhouse-server/users.d/default-password.xml and deleting this file will reset the password. See also /etc/clickhouse-server/users.xml on the server where ClickHouse is installed. . (AUTHENTICATION_FAILED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:66: DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000af5f1e9 6. /build/src/Access/AccessControl.cpp:625: DB::AccessControl::authenticate(DB::Credentials const&, Poco::Net::IPAddress const&, String const&) const @ 0x00000000194d0af9 7. /build/src/Interpreters/Session.cpp:352: DB::Session::authenticate(DB::Credentials const&, Poco::Net::SocketAddress const&) @ 0x000000001b8b2b47 8. /build/src/Interpreters/Session.cpp:332: DB::Session::authenticate(String const&, String const&, Poco::Net::SocketAddress const&) @ 0x000000001b8b1e49 9. /build/src/Server/TCPHandler.cpp:1532: DB::TCPHandler::receiveHello() @ 0x000000001d478a8f 10. /build/src/Server/TCPHandler.cpp:271: DB::TCPHandler::runImpl() @ 0x000000001d46cd2a 11. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 12. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 13. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 14. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 15. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 16. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 17. ? @ 0x00007f713a222ac3 18. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:02.243966 [ 4401 ] {66b7b66a-3ba6-4eb0-9b4b-82bcd4a7adfc} executeQuery: Code: 516. DB::Exception: Received from 127.0.0.2:9000. DB::Exception: default: Authentication failed: password is incorrect, or there is no user with such name. If you have installed ClickHouse and forgot password you can reset it in the configuration file. The password for default user is typically located at /etc/clickhouse-server/users.d/default-password.xml and deleting this file will reset the password. See also /etc/clickhouse-server/users.xml on the server where ClickHouse is installed. . Stack trace: 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:66: DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000af5f1e9 6. /build/src/Access/AccessControl.cpp:625: DB::AccessControl::authenticate(DB::Credentials const&, Poco::Net::IPAddress const&, String const&) const @ 0x00000000194d0af9 7. /build/src/Interpreters/Session.cpp:352: DB::Session::authenticate(DB::Credentials const&, Poco::Net::SocketAddress const&) @ 0x000000001b8b2b47 8. /build/src/Interpreters/Session.cpp:332: DB::Session::authenticate(String const&, String const&, Poco::Net::SocketAddress const&) @ 0x000000001b8b1e49 9. /build/src/Server/TCPHandler.cpp:1532: DB::TCPHandler::receiveHello() @ 0x000000001d478a8f 10. /build/src/Server/TCPHandler.cpp:271: DB::TCPHandler::runImpl() @ 0x000000001d46cd2a 11. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 12. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 13. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 14. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 15. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 16. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 17. ? @ 0x00007f713a222ac3 18. ? @ 0x00007f713a2b4850 : While sending /var/lib/clickhouse/store/46d/46dac8ce-79b7-4f55-8c4f-845d359eca50/default:foo@127%2E0%2E0%2E1:9000,default:foo@127%2E0%2E0%2E2:9000/1.bin. (AUTHENTICATION_FAILED) (version 24.3.12.76.altinitystable) (from [::1]:52252) (comment: 01555_system_distribution_queue_mask.sql) (in query: -- since test_cluster_with_incorrect_pw contains incorrect password ignore error system flush distributed dist_01555;), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:89: DB::Exception::Exception(String const&, int, bool) @ 0x000000000a942caa 5. /build/src/Common/Exception.h:97: DB::Exception::createDeprecated(String const&, int, bool) @ 0x000000000a942c55 6. /build/src/IO/ReadHelpers.cpp:1560: DB::readException(DB::ReadBuffer&, String const&, bool) @ 0x0000000013369f82 7. /build/src/Client/Connection.cpp:1233: DB::Connection::receiveException() const @ 0x000000001d2bdc59 8. /build/src/Client/Connection.cpp:452: DB::Connection::receiveHello(Poco::Timespan const&) @ 0x000000001d2bd125 9. /build/src/Client/Connection.cpp:200: DB::Connection::connect(DB::ConnectionTimeouts const&) @ 0x000000001d2bb571 10. /build/src/Client/Connection.cpp:0: DB::Connection::getServerRevision(DB::ConnectionTimeouts const&) @ 0x000000001d2bdff3 11. /build/src/Client/ConnectionEstablisher.cpp:44: DB::ConnectionEstablisher::run(PoolWithFailoverBase::TryResult&, String&) @ 0x000000001d2d1444 12. /build/src/Client/ConnectionPoolWithFailover.cpp:259: DB::ConnectionPoolWithFailover::tryGetEntry(std::shared_ptr const&, DB::ConnectionTimeouts const&, String&, DB::Settings const&, DB::QualifiedTableName const*, std::function) @ 0x000000001d2dd2b1 13. /build/src/Client/ConnectionPoolWithFailover.cpp:168: DB::ConnectionPoolWithFailover::getManyCheckedForInsert(DB::ConnectionTimeouts const&, DB::Settings const&, DB::PoolMode, DB::QualifiedTableName const&)::$_0::operator()(std::shared_ptr const&, String&) const @ 0x000000001d2deef7 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d2dee4c 15. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001d2dee0c 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d2dedcc 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d2ded77 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001d2e4f8d 19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001d2e460c 20. /build/src/Common/PoolWithFailoverBase.h:286: PoolWithFailoverBase::getMany(unsigned long, unsigned long, unsigned long, unsigned long, bool, bool, std::function::TryResult (std::shared_ptr const&, String&)> const&, std::function const&) @ 0x000000001d2e01c9 21. /build/src/Client/ConnectionPoolWithFailover.cpp:222: DB::ConnectionPoolWithFailover::getManyImpl(DB::Settings const&, DB::PoolMode, std::function::TryResult (std::shared_ptr const&, String&)> const&, std::optional, std::function, bool) @ 0x000000001d2dc9e5 22. /build/src/Client/ConnectionPoolWithFailover.cpp:170: DB::ConnectionPoolWithFailover::getManyCheckedForInsert(DB::ConnectionTimeouts const&, DB::Settings const&, DB::PoolMode, DB::QualifiedTableName const&) @ 0x000000001d2dce34 23. /build/src/Storages/Distributed/DistributedAsyncInsertDirectoryQueue.cpp:415: DB::DistributedAsyncInsertDirectoryQueue::processFile(String&, DB::SettingsChanges const&) @ 0x000000001ca20d10 24. /build/src/Storages/Distributed/DistributedAsyncInsertDirectoryQueue.cpp:377: DB::DistributedAsyncInsertDirectoryQueue::processFiles(DB::SettingsChanges const&) @ 0x000000001ca1cbbc 25. /build/src/Storages/Distributed/DistributedAsyncInsertDirectoryQueue.cpp:157: DB::DistributedAsyncInsertDirectoryQueue::flushAllData(DB::SettingsChanges const&) @ 0x000000001ca1c8e0 26. /build/src/Storages/StorageDistributed.cpp:1759: DB::StorageDistributed::flushClusterNodesAllDataImpl(std::shared_ptr, DB::SettingsChanges const&, bool)::$_0::operator()() const @ 0x000000001c34b069 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c34b035 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c34b015 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c34aff5 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c34afc0 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 2024.12.16 11:00:02.251679 [ 4401 ] {66b7b66a-3ba6-4eb0-9b4b-82bcd4a7adfc} TCPHandler: Code: 516. DB::Exception: Received from 127.0.0.2:9000. DB::Exception: default: Authentication failed: password is incorrect, or there is no user with such name. If you have installed ClickHouse and forgot password you can reset it in the configuration file. The password for default user is typically located at /etc/clickhouse-server/users.d/default-password.xml and deleting this file will reset the password. See also /etc/clickhouse-server/users.xml on the server where ClickHouse is installed. . Stack trace: 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:66: DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000af5f1e9 6. /build/src/Access/AccessControl.cpp:625: DB::AccessControl::authenticate(DB::Credentials const&, Poco::Net::IPAddress const&, String const&) const @ 0x00000000194d0af9 7. /build/src/Interpreters/Session.cpp:352: DB::Session::authenticate(DB::Credentials const&, Poco::Net::SocketAddress const&) @ 0x000000001b8b2b47 8. /build/src/Interpreters/Session.cpp:332: DB::Session::authenticate(String const&, String const&, Poco::Net::SocketAddress const&) @ 0x000000001b8b1e49 9. /build/src/Server/TCPHandler.cpp:1532: DB::TCPHandler::receiveHello() @ 0x000000001d478a8f 10. /build/src/Server/TCPHandler.cpp:271: DB::TCPHandler::runImpl() @ 0x000000001d46cd2a 11. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 12. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 13. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 14. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 15. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 16. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 17. ? @ 0x00007f713a222ac3 18. ? @ 0x00007f713a2b4850 : While sending /var/lib/clickhouse/store/46d/46dac8ce-79b7-4f55-8c4f-845d359eca50/default:foo@127%2E0%2E0%2E1:9000,default:foo@127%2E0%2E0%2E2:9000/1.bin. (AUTHENTICATION_FAILED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:89: DB::Exception::Exception(String const&, int, bool) @ 0x000000000a942caa 5. /build/src/Common/Exception.h:97: DB::Exception::createDeprecated(String const&, int, bool) @ 0x000000000a942c55 6. /build/src/IO/ReadHelpers.cpp:1560: DB::readException(DB::ReadBuffer&, String const&, bool) @ 0x0000000013369f82 7. /build/src/Client/Connection.cpp:1233: DB::Connection::receiveException() const @ 0x000000001d2bdc59 8. /build/src/Client/Connection.cpp:452: DB::Connection::receiveHello(Poco::Timespan const&) @ 0x000000001d2bd125 9. /build/src/Client/Connection.cpp:200: DB::Connection::connect(DB::ConnectionTimeouts const&) @ 0x000000001d2bb571 10. /build/src/Client/Connection.cpp:0: DB::Connection::getServerRevision(DB::ConnectionTimeouts const&) @ 0x000000001d2bdff3 11. /build/src/Client/ConnectionEstablisher.cpp:44: DB::ConnectionEstablisher::run(PoolWithFailoverBase::TryResult&, String&) @ 0x000000001d2d1444 12. /build/src/Client/ConnectionPoolWithFailover.cpp:259: DB::ConnectionPoolWithFailover::tryGetEntry(std::shared_ptr const&, DB::ConnectionTimeouts const&, String&, DB::Settings const&, DB::QualifiedTableName const*, std::function) @ 0x000000001d2dd2b1 13. /build/src/Client/ConnectionPoolWithFailover.cpp:168: DB::ConnectionPoolWithFailover::getManyCheckedForInsert(DB::ConnectionTimeouts const&, DB::Settings const&, DB::PoolMode, DB::QualifiedTableName const&)::$_0::operator()(std::shared_ptr const&, String&) const @ 0x000000001d2deef7 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d2dee4c 15. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001d2dee0c 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d2dedcc 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d2ded77 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001d2e4f8d 19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001d2e460c 20. /build/src/Common/PoolWithFailoverBase.h:286: PoolWithFailoverBase::getMany(unsigned long, unsigned long, unsigned long, unsigned long, bool, bool, std::function::TryResult (std::shared_ptr const&, String&)> const&, std::function const&) @ 0x000000001d2e01c9 21. /build/src/Client/ConnectionPoolWithFailover.cpp:222: DB::ConnectionPoolWithFailover::getManyImpl(DB::Settings const&, DB::PoolMode, std::function::TryResult (std::shared_ptr const&, String&)> const&, std::optional, std::function, bool) @ 0x000000001d2dc9e5 22. /build/src/Client/ConnectionPoolWithFailover.cpp:170: DB::ConnectionPoolWithFailover::getManyCheckedForInsert(DB::ConnectionTimeouts const&, DB::Settings const&, DB::PoolMode, DB::QualifiedTableName const&) @ 0x000000001d2dce34 23. /build/src/Storages/Distributed/DistributedAsyncInsertDirectoryQueue.cpp:415: DB::DistributedAsyncInsertDirectoryQueue::processFile(String&, DB::SettingsChanges const&) @ 0x000000001ca20d10 24. /build/src/Storages/Distributed/DistributedAsyncInsertDirectoryQueue.cpp:377: DB::DistributedAsyncInsertDirectoryQueue::processFiles(DB::SettingsChanges const&) @ 0x000000001ca1cbbc 25. /build/src/Storages/Distributed/DistributedAsyncInsertDirectoryQueue.cpp:157: DB::DistributedAsyncInsertDirectoryQueue::flushAllData(DB::SettingsChanges const&) @ 0x000000001ca1c8e0 26. /build/src/Storages/StorageDistributed.cpp:1759: DB::StorageDistributed::flushClusterNodesAllDataImpl(std::shared_ptr, DB::SettingsChanges const&, bool)::$_0::operator()() const @ 0x000000001c34b069 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c34b035 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c34b015 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c34aff5 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c34afc0 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 2024.12.16 11:00:02.762614 [ 3670 ] {89edb18f-4638-4be9-b536-c26e72950c15} executeQuery: Code: 60. DB::Exception: Could not find table: t1. (UNKNOWN_TABLE) (version 24.3.12.76.altinitystable) (from 0.0.0.0:0) (comment: 01671_ddl_hang_timeout_long.sh) (in query: /* ddl_entry=query-0000000006 */ ALTER TABLE test_r3um35dq.t1 ADD COLUMN `newcol` UInt32), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&) @ 0x000000000a942753 6. /build/src/Interpreters/InterpreterAlterQuery.cpp:124: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff90e8 7. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff7cde 8. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 9. /build/src/Interpreters/executeQuery.cpp:1496: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb4e89 10. /build/src/Interpreters/DDLWorker.cpp:497: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000001a652a89 11. /build/src/Interpreters/DDLWorker.cpp:661: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000001a651784 12. /build/src/Interpreters/DDLWorker.cpp:439: DB::DDLWorker::scheduleTasks(bool) @ 0x000000001a64f282 13. /build/src/Interpreters/DDLWorker.cpp:1147: DB::DDLWorker::runMainThread() @ 0x000000001a645293 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000001a665dc9 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&, 0ul>(void (DB::DDLWorker::*&)(), std::tuple&, std::__tuple_indices<0ul>) @ 0x000000001a665d4d 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(void (DB::DDLWorker::*&)(), std::tuple&) @ 0x000000001a665c9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::DDLWorker::*&&)(), DB::DDLWorker*&&)::'lambda'()::operator()() @ 0x000000001a665bb5 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a665b15 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a665af5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a665ad5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a665aa0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 11:00:02.767105 [ 2997 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:02.768898 [ 3670 ] {89edb18f-4638-4be9-b536-c26e72950c15} DDLWorker: Query /* ddl_entry=query-0000000006 */ ALTER TABLE test_r3um35dq.t1 ADD COLUMN `newcol` UInt32 wasn't finished successfully: Code: 60. DB::Exception: Could not find table: t1. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&) @ 0x000000000a942753 6. /build/src/Interpreters/InterpreterAlterQuery.cpp:124: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff90e8 7. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff7cde 8. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 9. /build/src/Interpreters/executeQuery.cpp:1496: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb4e89 10. /build/src/Interpreters/DDLWorker.cpp:497: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000001a652a89 11. /build/src/Interpreters/DDLWorker.cpp:661: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000001a651784 12. /build/src/Interpreters/DDLWorker.cpp:439: DB::DDLWorker::scheduleTasks(bool) @ 0x000000001a64f282 13. /build/src/Interpreters/DDLWorker.cpp:1147: DB::DDLWorker::runMainThread() @ 0x000000001a645293 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000001a665dc9 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&, 0ul>(void (DB::DDLWorker::*&)(), std::tuple&, std::__tuple_indices<0ul>) @ 0x000000001a665d4d 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(void (DB::DDLWorker::*&)(), std::tuple&) @ 0x000000001a665c9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::DDLWorker::*&&)(), DB::DDLWorker*&&)::'lambda'()::operator()() @ 0x000000001a665bb5 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a665b15 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a665af5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a665ad5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a665aa0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:04.029808 [ 3013 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:04.070351 [ 3868 ] {71b3f818-a93d-41bc-998c-60c07ac6309b} executeQuery: Code: 60. DB::Exception: There was an error on [localhost:9000]: Code: 60. DB::Exception: Could not find table: t1. (UNKNOWN_TABLE) (version 24.3.12.76.altinitystable). (UNKNOWN_TABLE) (version 24.3.12.76.altinitystable) (from [::1]:50134) (comment: 01671_ddl_hang_timeout_long.sh) (in query: ALTER TABLE test_r3um35dq.t1 on cluster test_shard_localhost ADD COLUMN newcol UInt32), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&, unsigned short&, String&) @ 0x000000001bb9f708 6. /build/src/Interpreters/executeDDLQueryOnCluster.cpp:574: DB::DDLQueryStatusSource::generate() @ 0x000000001bb99fe3 7. /build/src/Processors/ISource.cpp:139: DB::ISource::tryGenerate() @ 0x000000001d4f7ed0 8. /build/src/Processors/ISource.cpp:108: DB::ISource::work() @ 0x000000001d4f7bb6 9. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 10. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 11. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 12. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 13. /build/src/Processors/Executors/PipelineExecutor.cpp:411: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514ed5 14. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 15. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 16. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 18. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 19. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 20. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 27. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 28. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 30. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 31. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 2024.12.16 11:00:04.330897 [ 3868 ] {71b3f818-a93d-41bc-998c-60c07ac6309b} TCPHandler: Code: 60. DB::Exception: There was an error on [localhost:9000]: Code: 60. DB::Exception: Could not find table: t1. (UNKNOWN_TABLE) (version 24.3.12.76.altinitystable). (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&, unsigned short&, String&) @ 0x000000001bb9f708 6. /build/src/Interpreters/executeDDLQueryOnCluster.cpp:574: DB::DDLQueryStatusSource::generate() @ 0x000000001bb99fe3 7. /build/src/Processors/ISource.cpp:139: DB::ISource::tryGenerate() @ 0x000000001d4f7ed0 8. /build/src/Processors/ISource.cpp:108: DB::ISource::work() @ 0x000000001d4f7bb6 9. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 10. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 11. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 12. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 13. /build/src/Processors/Executors/PipelineExecutor.cpp:411: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514ed5 14. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 15. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 16. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 18. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 19. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 20. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 27. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 28. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 30. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 31. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 2024.12.16 11:00:04.331160 [ 4402 ] {} Access(user directories): from: ::ffff:127.0.0.1, user: default: Authentication failed: Code: 193. DB::Exception: Invalid credentials. (WRONG_PASSWORD), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f4eb7 6. /build/src/Access/IAccessStorage.cpp:763: DB::IAccessStorage::throwInvalidCredentials() @ 0x000000001962d15b 7. /build/src/Access/IAccessStorage.cpp:537: DB::IAccessStorage::authenticateImpl(DB::Credentials const&, Poco::Net::IPAddress const&, DB::ExternalAuthenticators const&, bool, bool, bool) const @ 0x000000001962ce1d 8. /build/src/Access/IAccessStorage.cpp:511: DB::IAccessStorage::authenticate(DB::Credentials const&, Poco::Net::IPAddress const&, DB::ExternalAuthenticators const&, bool, bool, bool) const @ 0x000000001962cbd3 9. /build/src/Access/MultipleAccessStorage.cpp:451: DB::MultipleAccessStorage::authenticateImpl(DB::Credentials const&, Poco::Net::IPAddress const&, DB::ExternalAuthenticators const&, bool, bool, bool) const @ 0x00000000196c148a 10. /build/src/Access/IAccessStorage.cpp:499: DB::IAccessStorage::authenticate(DB::Credentials const&, Poco::Net::IPAddress const&, DB::ExternalAuthenticators const&, bool, bool) const @ 0x000000001962cb08 11. /build/src/Access/AccessControl.cpp:600: DB::AccessControl::authenticate(DB::Credentials const&, Poco::Net::IPAddress const&, String const&) const @ 0x00000000194d065a 12. /build/src/Interpreters/Session.cpp:352: DB::Session::authenticate(DB::Credentials const&, Poco::Net::SocketAddress const&) @ 0x000000001b8b2b47 13. /build/src/Interpreters/Session.cpp:332: DB::Session::authenticate(String const&, String const&, Poco::Net::SocketAddress const&) @ 0x000000001b8b1e49 14. /build/src/Server/TCPHandler.cpp:1532: DB::TCPHandler::receiveHello() @ 0x000000001d478a8f 15. /build/src/Server/TCPHandler.cpp:271: DB::TCPHandler::runImpl() @ 0x000000001d46cd2a 16. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 17. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 18. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 19. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 20. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 21. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 22. ? @ 0x00007f713a222ac3 23. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:04.346857 [ 4402 ] {} ServerErrorHandler: Code: 516. DB::Exception: default: Authentication failed: password is incorrect, or there is no user with such name. If you have installed ClickHouse and forgot password you can reset it in the configuration file. The password for default user is typically located at /etc/clickhouse-server/users.d/default-password.xml and deleting this file will reset the password. See also /etc/clickhouse-server/users.xml on the server where ClickHouse is installed. . (AUTHENTICATION_FAILED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:66: DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000af5f1e9 6. /build/src/Access/AccessControl.cpp:625: DB::AccessControl::authenticate(DB::Credentials const&, Poco::Net::IPAddress const&, String const&) const @ 0x00000000194d0af9 7. /build/src/Interpreters/Session.cpp:352: DB::Session::authenticate(DB::Credentials const&, Poco::Net::SocketAddress const&) @ 0x000000001b8b2b47 8. /build/src/Interpreters/Session.cpp:332: DB::Session::authenticate(String const&, String const&, Poco::Net::SocketAddress const&) @ 0x000000001b8b1e49 9. /build/src/Server/TCPHandler.cpp:1532: DB::TCPHandler::receiveHello() @ 0x000000001d478a8f 10. /build/src/Server/TCPHandler.cpp:271: DB::TCPHandler::runImpl() @ 0x000000001d46cd2a 11. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 12. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 13. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 14. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 15. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 16. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 17. ? @ 0x00007f713a222ac3 18. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:04.754660 [ 4401 ] {66000363-af3b-4604-ac3b-750c0938904e} StorageDistributed (dist_01555): Cannot flush: Code: 516. DB::Exception: Received from 127.0.0.2:9000. DB::Exception: default: Authentication failed: password is incorrect, or there is no user with such name. If you have installed ClickHouse and forgot password you can reset it in the configuration file. The password for default user is typically located at /etc/clickhouse-server/users.d/default-password.xml and deleting this file will reset the password. See also /etc/clickhouse-server/users.xml on the server where ClickHouse is installed. . Stack trace: 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:66: DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000af5f1e9 6. /build/src/Access/AccessControl.cpp:625: DB::AccessControl::authenticate(DB::Credentials const&, Poco::Net::IPAddress const&, String const&) const @ 0x00000000194d0af9 7. /build/src/Interpreters/Session.cpp:352: DB::Session::authenticate(DB::Credentials const&, Poco::Net::SocketAddress const&) @ 0x000000001b8b2b47 8. /build/src/Interpreters/Session.cpp:332: DB::Session::authenticate(String const&, String const&, Poco::Net::SocketAddress const&) @ 0x000000001b8b1e49 9. /build/src/Server/TCPHandler.cpp:1532: DB::TCPHandler::receiveHello() @ 0x000000001d478a8f 10. /build/src/Server/TCPHandler.cpp:271: DB::TCPHandler::runImpl() @ 0x000000001d46cd2a 11. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 12. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 13. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 14. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 15. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 16. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 17. ? @ 0x00007f713a222ac3 18. ? @ 0x00007f713a2b4850 : While sending /var/lib/clickhouse/store/46d/46dac8ce-79b7-4f55-8c4f-845d359eca50/default:foo@127%2E0%2E0%2E1:9000,default:foo@127%2E0%2E0%2E2:9000/1.bin. (AUTHENTICATION_FAILED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:89: DB::Exception::Exception(String const&, int, bool) @ 0x000000000a942caa 5. /build/src/Common/Exception.h:97: DB::Exception::createDeprecated(String const&, int, bool) @ 0x000000000a942c55 6. /build/src/IO/ReadHelpers.cpp:1560: DB::readException(DB::ReadBuffer&, String const&, bool) @ 0x0000000013369f82 7. /build/src/Client/Connection.cpp:1233: DB::Connection::receiveException() const @ 0x000000001d2bdc59 8. /build/src/Client/Connection.cpp:452: DB::Connection::receiveHello(Poco::Timespan const&) @ 0x000000001d2bd125 9. /build/src/Client/Connection.cpp:200: DB::Connection::connect(DB::ConnectionTimeouts const&) @ 0x000000001d2bb571 10. /build/src/Client/Connection.cpp:541: DB::Connection::forceConnected(DB::ConnectionTimeouts const&) @ 0x000000001d2be7c2 11. /build/src/Client/ConnectionEstablisher.cpp:48: DB::ConnectionEstablisher::run(PoolWithFailoverBase::TryResult&, String&) @ 0x000000001d2d150f 12. /build/src/Client/ConnectionPoolWithFailover.cpp:259: DB::ConnectionPoolWithFailover::tryGetEntry(std::shared_ptr const&, DB::ConnectionTimeouts const&, String&, DB::Settings const&, DB::QualifiedTableName const*, std::function) @ 0x000000001d2dd2b1 13. /build/src/Client/ConnectionPoolWithFailover.cpp:168: DB::ConnectionPoolWithFailover::getManyCheckedForInsert(DB::ConnectionTimeouts const&, DB::Settings const&, DB::PoolMode, DB::QualifiedTableName const&)::$_0::operator()(std::shared_ptr const&, String&) const @ 0x000000001d2deef7 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d2dee4c 15. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001d2dee0c 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d2dedcc 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d2ded77 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001d2e4f8d 19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001d2e460c 20. /build/src/Common/PoolWithFailoverBase.h:286: PoolWithFailoverBase::getMany(unsigned long, unsigned long, unsigned long, unsigned long, bool, bool, std::function::TryResult (std::shared_ptr const&, String&)> const&, std::function const&) @ 0x000000001d2e01c9 21. /build/src/Client/ConnectionPoolWithFailover.cpp:222: DB::ConnectionPoolWithFailover::getManyImpl(DB::Settings const&, DB::PoolMode, std::function::TryResult (std::shared_ptr const&, String&)> const&, std::optional, std::function, bool) @ 0x000000001d2dc9e5 22. /build/src/Client/ConnectionPoolWithFailover.cpp:170: DB::ConnectionPoolWithFailover::getManyCheckedForInsert(DB::ConnectionTimeouts const&, DB::Settings const&, DB::PoolMode, DB::QualifiedTableName const&) @ 0x000000001d2dce34 23. /build/src/Storages/Distributed/DistributedAsyncInsertDirectoryQueue.cpp:415: DB::DistributedAsyncInsertDirectoryQueue::processFile(String&, DB::SettingsChanges const&) @ 0x000000001ca20d10 24. /build/src/Storages/Distributed/DistributedAsyncInsertDirectoryQueue.cpp:374: DB::DistributedAsyncInsertDirectoryQueue::processFiles(DB::SettingsChanges const&) @ 0x000000001ca1cb26 25. /build/src/Storages/Distributed/DistributedAsyncInsertDirectoryQueue.cpp:157: DB::DistributedAsyncInsertDirectoryQueue::flushAllData(DB::SettingsChanges const&) @ 0x000000001ca1c8e0 26. /build/src/Storages/StorageDistributed.cpp:1759: DB::StorageDistributed::flushClusterNodesAllDataImpl(std::shared_ptr, DB::SettingsChanges const&, bool)::$_0::operator()() const @ 0x000000001c34b069 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c34b035 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c34b015 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c34aff5 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c34afc0 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:04.889554 [ 3484 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {fe54ed48-ddd9-4cf8-aa3b-418c81cf437c::202412_1_67_11}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=5). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:45: DB::MergeTreeDataPartWriterOnDisk::Stream::preFinalize() @ 0x000000001cce590d 21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:644: DB::MergeTreeDataPartWriterWide::fillDataChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set, std::equal_to, std::allocator>&) @ 0x000000001ccf2d83 22. /build/src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set, std::equal_to, std::allocator>&) @ 0x000000001ccf327e 23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf3803a 24. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37f43 25. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb722bf 26. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb725d8 27. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb71fb2 28. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13ef38 29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x000000001cba15ed 30. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x000000001cba210e 31. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef, StrongTypedef, std::basic_string_view>)::'lambda'()::operator()() const @ 0x000000001cba9c78 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:05.057498 [ 3026 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:05.057346 [ 6123 ] {bc40e9f0-9b84-4216-a99a-e9d4f7fc1dc9} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=2, jobs=2). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:50150) (comment: 01083_window_view_select.sh) (in query: SELECT count(*) FROM wv), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 11:00:05.102789 [ 6123 ] {bc40e9f0-9b84-4216-a99a-e9d4f7fc1dc9} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=2, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 11:00:05.785789 [ 3545 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::PartLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:147: DB::IMergeTreeDataPart::MinMaxIndex::store(std::vector> const&, std::vector, std::allocator>> const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caad019 21. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:118: DB::IMergeTreeDataPart::MinMaxIndex::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caab9fb 22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:244: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39ccf 23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 26. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:06.072026 [ 3056 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:07.071841 [ 3549 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::TextLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:294: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf3a8b6 21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:07.091759 [ 3083 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:07.228995 [ 2758 ] {35e44cb9-42b3-41b5-babb-d8171b191ba8} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=1, jobs=1). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:50154) (comment: 03165_distinct_with_window_func_crash.sql) (in query: SELECT DISTINCT loanx_id, rating_sp, cdu_date, row_number() OVER (PARTITION BY cdu_date) AS row_number, last_value(cdu_date) OVER (PARTITION BY loanx_id ORDER BY cdu_date ASC) AS last_cdu_date FROM atable GROUP BY cdu_date, loanx_id, rating_sp SETTINGS query_plan_remove_redundant_distinct = 1;), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 11:00:07.260628 [ 3868 ] {} Access(user directories): from: ::ffff:127.0.0.1, user: default: Authentication failed: Code: 193. DB::Exception: Invalid credentials. (WRONG_PASSWORD), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f4eb7 6. /build/src/Access/IAccessStorage.cpp:763: DB::IAccessStorage::throwInvalidCredentials() @ 0x000000001962d15b 7. /build/src/Access/IAccessStorage.cpp:537: DB::IAccessStorage::authenticateImpl(DB::Credentials const&, Poco::Net::IPAddress const&, DB::ExternalAuthenticators const&, bool, bool, bool) const @ 0x000000001962ce1d 8. /build/src/Access/IAccessStorage.cpp:511: DB::IAccessStorage::authenticate(DB::Credentials const&, Poco::Net::IPAddress const&, DB::ExternalAuthenticators const&, bool, bool, bool) const @ 0x000000001962cbd3 9. /build/src/Access/MultipleAccessStorage.cpp:451: DB::MultipleAccessStorage::authenticateImpl(DB::Credentials const&, Poco::Net::IPAddress const&, DB::ExternalAuthenticators const&, bool, bool, bool) const @ 0x00000000196c148a 10. /build/src/Access/IAccessStorage.cpp:499: DB::IAccessStorage::authenticate(DB::Credentials const&, Poco::Net::IPAddress const&, DB::ExternalAuthenticators const&, bool, bool) const @ 0x000000001962cb08 11. /build/src/Access/AccessControl.cpp:600: DB::AccessControl::authenticate(DB::Credentials const&, Poco::Net::IPAddress const&, String const&) const @ 0x00000000194d065a 12. /build/src/Interpreters/Session.cpp:352: DB::Session::authenticate(DB::Credentials const&, Poco::Net::SocketAddress const&) @ 0x000000001b8b2b47 13. /build/src/Interpreters/Session.cpp:332: DB::Session::authenticate(String const&, String const&, Poco::Net::SocketAddress const&) @ 0x000000001b8b1e49 14. /build/src/Server/TCPHandler.cpp:1532: DB::TCPHandler::receiveHello() @ 0x000000001d478a8f 15. /build/src/Server/TCPHandler.cpp:271: DB::TCPHandler::runImpl() @ 0x000000001d46cd2a 16. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 17. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 18. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 19. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 20. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 21. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 22. ? @ 0x00007f713a222ac3 23. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:07.279381 [ 3868 ] {} ServerErrorHandler: Code: 516. DB::Exception: default: Authentication failed: password is incorrect, or there is no user with such name. If you have installed ClickHouse and forgot password you can reset it in the configuration file. The password for default user is typically located at /etc/clickhouse-server/users.d/default-password.xml and deleting this file will reset the password. See also /etc/clickhouse-server/users.xml on the server where ClickHouse is installed. . (AUTHENTICATION_FAILED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:66: DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000af5f1e9 6. /build/src/Access/AccessControl.cpp:625: DB::AccessControl::authenticate(DB::Credentials const&, Poco::Net::IPAddress const&, String const&) const @ 0x00000000194d0af9 7. /build/src/Interpreters/Session.cpp:352: DB::Session::authenticate(DB::Credentials const&, Poco::Net::SocketAddress const&) @ 0x000000001b8b2b47 8. /build/src/Interpreters/Session.cpp:332: DB::Session::authenticate(String const&, String const&, Poco::Net::SocketAddress const&) @ 0x000000001b8b1e49 9. /build/src/Server/TCPHandler.cpp:1532: DB::TCPHandler::receiveHello() @ 0x000000001d478a8f 10. /build/src/Server/TCPHandler.cpp:271: DB::TCPHandler::runImpl() @ 0x000000001d46cd2a 11. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 12. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 13. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 14. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 15. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 16. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 17. ? @ 0x00007f713a222ac3 18. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:07.709442 [ 2758 ] {35e44cb9-42b3-41b5-babb-d8171b191ba8} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=1, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 11:00:07.709711 [ 5023 ] {b16a396a-076d-4eab-ac62-5833571f0cc8} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=13, jobs=13). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::ffff:127.0.0.1]:59522) (comment: 00159_parallel_formatting_http.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a,MobilePhoneModel as b,ClientIP6 as c FROM test.hits ORDER BY a,b,c LIMIT 1000000 Format CSV ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 13. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 14. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 15. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 16. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 17. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 18. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 19. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 20. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 21. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 22. ? @ 0x00007f713a222ac3 23. ? @ 0x00007f713a2b4850 2024.12.16 11:00:07.712435 [ 4182 ] {88908d15-43c5-4e47-9135-2311be402d18} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=9, jobs=9). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:50170) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM system.processes WHERE query_id != queryID() AND current_database = currentDatabase() AND query LIKE '%-- 11317_tuple%'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 11:00:07.814083 [ 3395 ] {} test_87w7g7ko.dist_01555.DistributedInsertQueue.default: Code: 516. DB::Exception: Received from 127.0.0.1:9000. DB::Exception: default: Authentication failed: password is incorrect, or there is no user with such name. If you have installed ClickHouse and forgot password you can reset it in the configuration file. The password for default user is typically located at /etc/clickhouse-server/users.d/default-password.xml and deleting this file will reset the password. See also /etc/clickhouse-server/users.xml on the server where ClickHouse is installed. . Stack trace: 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:66: DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000af5f1e9 6. /build/src/Access/AccessControl.cpp:625: DB::AccessControl::authenticate(DB::Credentials const&, Poco::Net::IPAddress const&, String const&) const @ 0x00000000194d0af9 7. /build/src/Interpreters/Session.cpp:352: DB::Session::authenticate(DB::Credentials const&, Poco::Net::SocketAddress const&) @ 0x000000001b8b2b47 8. /build/src/Interpreters/Session.cpp:332: DB::Session::authenticate(String const&, String const&, Poco::Net::SocketAddress const&) @ 0x000000001b8b1e49 9. /build/src/Server/TCPHandler.cpp:1532: DB::TCPHandler::receiveHello() @ 0x000000001d478a8f 10. /build/src/Server/TCPHandler.cpp:271: DB::TCPHandler::runImpl() @ 0x000000001d46cd2a 11. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 12. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 13. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 14. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 15. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 16. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 17. ? @ 0x00007f713a222ac3 18. ? @ 0x00007f713a2b4850 : While sending /var/lib/clickhouse/store/4c8/4c8c8318-c4bc-40eb-8c5f-dfef2373873b/default:foo@127%2E0%2E0%2E1:9000,default:foo@127%2E0%2E0%2E2:9000/1.bin. (AUTHENTICATION_FAILED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:89: DB::Exception::Exception(String const&, int, bool) @ 0x000000000a942caa 5. /build/src/Common/Exception.h:97: DB::Exception::createDeprecated(String const&, int, bool) @ 0x000000000a942c55 6. /build/src/IO/ReadHelpers.cpp:1560: DB::readException(DB::ReadBuffer&, String const&, bool) @ 0x0000000013369f82 7. /build/src/Client/Connection.cpp:1233: DB::Connection::receiveException() const @ 0x000000001d2bdc59 8. /build/src/Client/Connection.cpp:452: DB::Connection::receiveHello(Poco::Timespan const&) @ 0x000000001d2bd125 9. /build/src/Client/Connection.cpp:200: DB::Connection::connect(DB::ConnectionTimeouts const&) @ 0x000000001d2bb571 10. /build/src/Client/Connection.cpp:0: DB::Connection::getServerRevision(DB::ConnectionTimeouts const&) @ 0x000000001d2bdff3 11. /build/src/Client/ConnectionEstablisher.cpp:44: DB::ConnectionEstablisher::run(PoolWithFailoverBase::TryResult&, String&) @ 0x000000001d2d1444 12. /build/src/Client/ConnectionPoolWithFailover.cpp:259: DB::ConnectionPoolWithFailover::tryGetEntry(std::shared_ptr const&, DB::ConnectionTimeouts const&, String&, DB::Settings const&, DB::QualifiedTableName const*, std::function) @ 0x000000001d2dd2b1 13. /build/src/Client/ConnectionPoolWithFailover.cpp:168: DB::ConnectionPoolWithFailover::getManyCheckedForInsert(DB::ConnectionTimeouts const&, DB::Settings const&, DB::PoolMode, DB::QualifiedTableName const&)::$_0::operator()(std::shared_ptr const&, String&) const @ 0x000000001d2deef7 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d2dee4c 15. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001d2dee0c 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d2dedcc 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d2ded77 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001d2e4f8d 19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001d2e460c 20. /build/src/Common/PoolWithFailoverBase.h:286: PoolWithFailoverBase::getMany(unsigned long, unsigned long, unsigned long, unsigned long, bool, bool, std::function::TryResult (std::shared_ptr const&, String&)> const&, std::function const&) @ 0x000000001d2e01c9 21. /build/src/Client/ConnectionPoolWithFailover.cpp:222: DB::ConnectionPoolWithFailover::getManyImpl(DB::Settings const&, DB::PoolMode, std::function::TryResult (std::shared_ptr const&, String&)> const&, std::optional, std::function, bool) @ 0x000000001d2dc9e5 22. /build/src/Client/ConnectionPoolWithFailover.cpp:170: DB::ConnectionPoolWithFailover::getManyCheckedForInsert(DB::ConnectionTimeouts const&, DB::Settings const&, DB::PoolMode, DB::QualifiedTableName const&) @ 0x000000001d2dce34 23. /build/src/Storages/Distributed/DistributedAsyncInsertDirectoryQueue.cpp:415: DB::DistributedAsyncInsertDirectoryQueue::processFile(String&, DB::SettingsChanges const&) @ 0x000000001ca20d10 24. /build/src/Storages/Distributed/DistributedAsyncInsertDirectoryQueue.cpp:377: DB::DistributedAsyncInsertDirectoryQueue::processFiles(DB::SettingsChanges const&) @ 0x000000001ca1cbbc 25. /build/src/Storages/Distributed/DistributedAsyncInsertDirectoryQueue.cpp:200: DB::DistributedAsyncInsertDirectoryQueue::run() @ 0x000000001ca1cff5 26. /build/src/Storages/Distributed/DistributedAsyncInsertDirectoryQueue.cpp:135: DB::DistributedAsyncInsertDirectoryQueue::DistributedAsyncInsertDirectoryQueue(DB::StorageDistributed&, std::shared_ptr const&, String const&, std::shared_ptr, DB::ActionBlocker&, DB::BackgroundSchedulePool&)::$_0::operator()() const @ 0x000000001ca244d8 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ca244b5 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ca24495 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ca24475 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ca2443d 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:07.814344 [ 3482 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {c55ac4aa-92c9-4d4b-932f-d2ce86c8486d::202412_1_41_8}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1fc91 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1fb3b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1faf0 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1fab0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1fa3b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce216d1 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1f750 16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future> DB::scheduleFromThreadPoolUnsafe, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl>&, String const&, Priority) @ 0x000000001ce1f09c 17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1d6c3 18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl>*, unsigned long) @ 0x000000001ce1d5b3 19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*, unsigned long, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&&, unsigned long&&) @ 0x000000001ce56a2c 20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*, unsigned long, void, void>(std::allocator&, DB::MergeTreeMarksLoader*, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&&, unsigned long&&) @ 0x000000001ce56935 21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*, unsigned long>(std::allocator, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&&, unsigned long&&) @ 0x000000001ce56863 22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], std::shared_ptr&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*, unsigned long, void>(std::allocator const&, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&&, unsigned long&&) @ 0x000000001ce56715 23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*, unsigned long, void>(std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&&, unsigned long&&) @ 0x000000001ce53cbb 24. /build/src/Storages/MergeTree/MergeTreeReaderCompact.cpp:37: DB::MergeTreeReaderCompact::MergeTreeReaderCompact(std::shared_ptr, DB::NamesAndTypesList, std::unordered_map, std::equal_to, std::allocator>> const&, std::shared_ptr const&, DB::UncompressedCache*, DB::MarkCache*, DB::MarkRanges, DB::MergeTreeReaderSettings, std::map, std::allocator>>, std::function const&, int) @ 0x000000001ce51f0a 25. /build/src/Storages/MergeTree/MergeTreeReaderCompactSingleBuffer.h:16: DB::MergeTreeReaderCompactSingleBuffer::MergeTreeReaderCompactSingleBuffer&, DB::NamesAndTypesList const&, std::unordered_map, std::equal_to, std::allocator>> const&, std::shared_ptr const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map, std::allocator>> const&, std::function const&, int>(std::shared_ptr&, DB::NamesAndTypesList const&, std::unordered_map, std::equal_to, std::allocator>> const&, std::shared_ptr const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map, std::allocator>> const&, std::function const&, int&&) @ 0x000000001ccc27a5 26. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, DB::NamesAndTypesList const&, std::unordered_map, std::equal_to, std::allocator>> const&, std::shared_ptr const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map, std::allocator>> const&, std::function const&, int>(std::shared_ptr&, DB::NamesAndTypesList const&, std::unordered_map, std::equal_to, std::allocator>> const&, std::shared_ptr const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map, std::allocator>> const&, std::function const&, int&&) @ 0x000000001ccc1b7d 27. /build/src/Storages/MergeTree/MergeTreeDataPartCompact.cpp:43: DB::MergeTreeDataPartCompact::getReader(DB::NamesAndTypesList const&, std::shared_ptr const&, DB::MarkRanges const&, std::unordered_map, std::equal_to, std::allocator>> const&, DB::UncompressedCache*, DB::MarkCache*, std::shared_ptr const&, DB::MergeTreeReaderSettings const&, std::map, std::allocator>> const&, std::function const&) const @ 0x000000001ccbeef3 28. /build/src/Storages/MergeTree/MergeTreeSequentialSource.cpp:177: DB::MergeTreeSequentialSource::MergeTreeSequentialSource(DB::MergeTreeSequentialSourceType, DB::MergeTreeData const&, std::shared_ptr const&, std::shared_ptr, std::vector>, std::optional, bool, bool, bool, bool) @ 0x000000001ce71ef0 29. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeSequentialSource* std::construct_at[abi:v15000] const&, std::shared_ptr&, std::vector>&, std::optional, bool, bool&, bool&, bool&, DB::MergeTreeSequentialSource*>(DB::MergeTreeSequentialSource*, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr const&, std::shared_ptr&, std::vector>&, std::optional&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce76047 30. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000] const&, std::shared_ptr&, std::vector>&, std::optional, bool, bool&, bool&, bool&, void, void>(std::allocator&, DB::MergeTreeSequentialSource*, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr const&, std::shared_ptr&, std::vector>&, std::optional&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce75d04 31. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000] const&, std::shared_ptr&, std::vector>&, std::optional, bool, bool&, bool&, bool&>(std::allocator, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr const&, std::shared_ptr&, std::vector>&, std::optional&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce759b1 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:07.816482 [ 4182 ] {88908d15-43c5-4e47-9135-2311be402d18} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=9, jobs=9). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 11:00:07.851982 [ 4402 ] {} Access(user directories): from: ::ffff:127.0.0.1, user: default: Authentication failed: Code: 193. DB::Exception: Invalid credentials. (WRONG_PASSWORD), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f4eb7 6. /build/src/Access/IAccessStorage.cpp:763: DB::IAccessStorage::throwInvalidCredentials() @ 0x000000001962d15b 7. /build/src/Access/IAccessStorage.cpp:537: DB::IAccessStorage::authenticateImpl(DB::Credentials const&, Poco::Net::IPAddress const&, DB::ExternalAuthenticators const&, bool, bool, bool) const @ 0x000000001962ce1d 8. /build/src/Access/IAccessStorage.cpp:511: DB::IAccessStorage::authenticate(DB::Credentials const&, Poco::Net::IPAddress const&, DB::ExternalAuthenticators const&, bool, bool, bool) const @ 0x000000001962cbd3 9. /build/src/Access/MultipleAccessStorage.cpp:451: DB::MultipleAccessStorage::authenticateImpl(DB::Credentials const&, Poco::Net::IPAddress const&, DB::ExternalAuthenticators const&, bool, bool, bool) const @ 0x00000000196c148a 10. /build/src/Access/IAccessStorage.cpp:499: DB::IAccessStorage::authenticate(DB::Credentials const&, Poco::Net::IPAddress const&, DB::ExternalAuthenticators const&, bool, bool) const @ 0x000000001962cb08 11. /build/src/Access/AccessControl.cpp:600: DB::AccessControl::authenticate(DB::Credentials const&, Poco::Net::IPAddress const&, String const&) const @ 0x00000000194d065a 12. /build/src/Interpreters/Session.cpp:352: DB::Session::authenticate(DB::Credentials const&, Poco::Net::SocketAddress const&) @ 0x000000001b8b2b47 13. /build/src/Interpreters/Session.cpp:332: DB::Session::authenticate(String const&, String const&, Poco::Net::SocketAddress const&) @ 0x000000001b8b1e49 14. /build/src/Server/TCPHandler.cpp:1532: DB::TCPHandler::receiveHello() @ 0x000000001d478a8f 15. /build/src/Server/TCPHandler.cpp:271: DB::TCPHandler::runImpl() @ 0x000000001d46cd2a 16. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 17. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 18. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 19. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 20. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 21. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 22. ? @ 0x00007f713a222ac3 23. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:07.870216 [ 4401 ] {45de3c8b-4a3e-4da9-9585-0824be4e3142} executeQuery: Code: 516. DB::Exception: Received from 127.0.0.1:9000. DB::Exception: default: Authentication failed: password is incorrect, or there is no user with such name. If you have installed ClickHouse and forgot password you can reset it in the configuration file. The password for default user is typically located at /etc/clickhouse-server/users.d/default-password.xml and deleting this file will reset the password. See also /etc/clickhouse-server/users.xml on the server where ClickHouse is installed. . Stack trace: 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:66: DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000af5f1e9 6. /build/src/Access/AccessControl.cpp:625: DB::AccessControl::authenticate(DB::Credentials const&, Poco::Net::IPAddress const&, String const&) const @ 0x00000000194d0af9 7. /build/src/Interpreters/Session.cpp:352: DB::Session::authenticate(DB::Credentials const&, Poco::Net::SocketAddress const&) @ 0x000000001b8b2b47 8. /build/src/Interpreters/Session.cpp:332: DB::Session::authenticate(String const&, String const&, Poco::Net::SocketAddress const&) @ 0x000000001b8b1e49 9. /build/src/Server/TCPHandler.cpp:1532: DB::TCPHandler::receiveHello() @ 0x000000001d478a8f 10. /build/src/Server/TCPHandler.cpp:271: DB::TCPHandler::runImpl() @ 0x000000001d46cd2a 11. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 12. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 13. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 14. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 15. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 16. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 17. ? @ 0x00007f713a222ac3 18. ? @ 0x00007f713a2b4850 : While sending /var/lib/clickhouse/store/4c8/4c8c8318-c4bc-40eb-8c5f-dfef2373873b/default:foo@127%2E0%2E0%2E1:9000,default:foo@127%2E0%2E0%2E2:9000/1.bin. (AUTHENTICATION_FAILED) (version 24.3.12.76.altinitystable) (from [::1]:52252) (comment: 01555_system_distribution_queue_mask.sql) (in query: -- since test_cluster_with_incorrect_pw contains incorrect password ignore error system flush distributed dist_01555;), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:89: DB::Exception::Exception(String const&, int, bool) @ 0x000000000a942caa 5. /build/src/Common/Exception.h:97: DB::Exception::createDeprecated(String const&, int, bool) @ 0x000000000a942c55 6. /build/src/IO/ReadHelpers.cpp:1560: DB::readException(DB::ReadBuffer&, String const&, bool) @ 0x0000000013369f82 7. /build/src/Client/Connection.cpp:1233: DB::Connection::receiveException() const @ 0x000000001d2bdc59 8. /build/src/Client/Connection.cpp:452: DB::Connection::receiveHello(Poco::Timespan const&) @ 0x000000001d2bd125 9. /build/src/Client/Connection.cpp:200: DB::Connection::connect(DB::ConnectionTimeouts const&) @ 0x000000001d2bb571 10. /build/src/Client/Connection.cpp:541: DB::Connection::forceConnected(DB::ConnectionTimeouts const&) @ 0x000000001d2be7c2 11. /build/src/Client/ConnectionEstablisher.cpp:48: DB::ConnectionEstablisher::run(PoolWithFailoverBase::TryResult&, String&) @ 0x000000001d2d150f 12. /build/src/Client/ConnectionPoolWithFailover.cpp:259: DB::ConnectionPoolWithFailover::tryGetEntry(std::shared_ptr const&, DB::ConnectionTimeouts const&, String&, DB::Settings const&, DB::QualifiedTableName const*, std::function) @ 0x000000001d2dd2b1 13. /build/src/Client/ConnectionPoolWithFailover.cpp:168: DB::ConnectionPoolWithFailover::getManyCheckedForInsert(DB::ConnectionTimeouts const&, DB::Settings const&, DB::PoolMode, DB::QualifiedTableName const&)::$_0::operator()(std::shared_ptr const&, String&) const @ 0x000000001d2deef7 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d2dee4c 15. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001d2dee0c 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d2dedcc 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d2ded77 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001d2e4f8d 19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001d2e460c 20. /build/src/Common/PoolWithFailoverBase.h:286: PoolWithFailoverBase::getMany(unsigned long, unsigned long, unsigned long, unsigned long, bool, bool, std::function::TryResult (std::shared_ptr const&, String&)> const&, std::function const&) @ 0x000000001d2e01c9 21. /build/src/Client/ConnectionPoolWithFailover.cpp:222: DB::ConnectionPoolWithFailover::getManyImpl(DB::Settings const&, DB::PoolMode, std::function::TryResult (std::shared_ptr const&, String&)> const&, std::optional, std::function, bool) @ 0x000000001d2dc9e5 22. /build/src/Client/ConnectionPoolWithFailover.cpp:170: DB::ConnectionPoolWithFailover::getManyCheckedForInsert(DB::ConnectionTimeouts const&, DB::Settings const&, DB::PoolMode, DB::QualifiedTableName const&) @ 0x000000001d2dce34 23. /build/src/Storages/Distributed/DistributedAsyncInsertDirectoryQueue.cpp:415: DB::DistributedAsyncInsertDirectoryQueue::processFile(String&, DB::SettingsChanges const&) @ 0x000000001ca20d10 24. /build/src/Storages/Distributed/DistributedAsyncInsertDirectoryQueue.cpp:374: DB::DistributedAsyncInsertDirectoryQueue::processFiles(DB::SettingsChanges const&) @ 0x000000001ca1cb26 25. /build/src/Storages/Distributed/DistributedAsyncInsertDirectoryQueue.cpp:157: DB::DistributedAsyncInsertDirectoryQueue::flushAllData(DB::SettingsChanges const&) @ 0x000000001ca1c8e0 26. /build/src/Storages/StorageDistributed.cpp:1759: DB::StorageDistributed::flushClusterNodesAllDataImpl(std::shared_ptr, DB::SettingsChanges const&, bool)::$_0::operator()() const @ 0x000000001c34b069 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c34b035 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c34b015 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c34aff5 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c34afc0 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 2024.12.16 11:00:07.870077 [ 4402 ] {} ServerErrorHandler: Code: 516. DB::Exception: default: Authentication failed: password is incorrect, or there is no user with such name. If you have installed ClickHouse and forgot password you can reset it in the configuration file. The password for default user is typically located at /etc/clickhouse-server/users.d/default-password.xml and deleting this file will reset the password. See also /etc/clickhouse-server/users.xml on the server where ClickHouse is installed. . (AUTHENTICATION_FAILED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:66: DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000af5f1e9 6. /build/src/Access/AccessControl.cpp:625: DB::AccessControl::authenticate(DB::Credentials const&, Poco::Net::IPAddress const&, String const&) const @ 0x00000000194d0af9 7. /build/src/Interpreters/Session.cpp:352: DB::Session::authenticate(DB::Credentials const&, Poco::Net::SocketAddress const&) @ 0x000000001b8b2b47 8. /build/src/Interpreters/Session.cpp:332: DB::Session::authenticate(String const&, String const&, Poco::Net::SocketAddress const&) @ 0x000000001b8b1e49 9. /build/src/Server/TCPHandler.cpp:1532: DB::TCPHandler::receiveHello() @ 0x000000001d478a8f 10. /build/src/Server/TCPHandler.cpp:271: DB::TCPHandler::runImpl() @ 0x000000001d46cd2a 11. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 12. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 13. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 14. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 15. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 16. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 17. ? @ 0x00007f713a222ac3 18. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:07.880957 [ 4401 ] {45de3c8b-4a3e-4da9-9585-0824be4e3142} TCPHandler: Code: 516. DB::Exception: Received from 127.0.0.1:9000. DB::Exception: default: Authentication failed: password is incorrect, or there is no user with such name. If you have installed ClickHouse and forgot password you can reset it in the configuration file. The password for default user is typically located at /etc/clickhouse-server/users.d/default-password.xml and deleting this file will reset the password. See also /etc/clickhouse-server/users.xml on the server where ClickHouse is installed. . Stack trace: 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:66: DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000af5f1e9 6. /build/src/Access/AccessControl.cpp:625: DB::AccessControl::authenticate(DB::Credentials const&, Poco::Net::IPAddress const&, String const&) const @ 0x00000000194d0af9 7. /build/src/Interpreters/Session.cpp:352: DB::Session::authenticate(DB::Credentials const&, Poco::Net::SocketAddress const&) @ 0x000000001b8b2b47 8. /build/src/Interpreters/Session.cpp:332: DB::Session::authenticate(String const&, String const&, Poco::Net::SocketAddress const&) @ 0x000000001b8b1e49 9. /build/src/Server/TCPHandler.cpp:1532: DB::TCPHandler::receiveHello() @ 0x000000001d478a8f 10. /build/src/Server/TCPHandler.cpp:271: DB::TCPHandler::runImpl() @ 0x000000001d46cd2a 11. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 12. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 13. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 14. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 15. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 16. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 17. ? @ 0x00007f713a222ac3 18. ? @ 0x00007f713a2b4850 : While sending /var/lib/clickhouse/store/4c8/4c8c8318-c4bc-40eb-8c5f-dfef2373873b/default:foo@127%2E0%2E0%2E1:9000,default:foo@127%2E0%2E0%2E2:9000/1.bin. (AUTHENTICATION_FAILED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:89: DB::Exception::Exception(String const&, int, bool) @ 0x000000000a942caa 5. /build/src/Common/Exception.h:97: DB::Exception::createDeprecated(String const&, int, bool) @ 0x000000000a942c55 6. /build/src/IO/ReadHelpers.cpp:1560: DB::readException(DB::ReadBuffer&, String const&, bool) @ 0x0000000013369f82 7. /build/src/Client/Connection.cpp:1233: DB::Connection::receiveException() const @ 0x000000001d2bdc59 8. /build/src/Client/Connection.cpp:452: DB::Connection::receiveHello(Poco::Timespan const&) @ 0x000000001d2bd125 9. /build/src/Client/Connection.cpp:200: DB::Connection::connect(DB::ConnectionTimeouts const&) @ 0x000000001d2bb571 10. /build/src/Client/Connection.cpp:541: DB::Connection::forceConnected(DB::ConnectionTimeouts const&) @ 0x000000001d2be7c2 11. /build/src/Client/ConnectionEstablisher.cpp:48: DB::ConnectionEstablisher::run(PoolWithFailoverBase::TryResult&, String&) @ 0x000000001d2d150f 12. /build/src/Client/ConnectionPoolWithFailover.cpp:259: DB::ConnectionPoolWithFailover::tryGetEntry(std::shared_ptr const&, DB::ConnectionTimeouts const&, String&, DB::Settings const&, DB::QualifiedTableName const*, std::function) @ 0x000000001d2dd2b1 13. /build/src/Client/ConnectionPoolWithFailover.cpp:168: DB::ConnectionPoolWithFailover::getManyCheckedForInsert(DB::ConnectionTimeouts const&, DB::Settings const&, DB::PoolMode, DB::QualifiedTableName const&)::$_0::operator()(std::shared_ptr const&, String&) const @ 0x000000001d2deef7 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d2dee4c 15. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001d2dee0c 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d2dedcc 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d2ded77 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001d2e4f8d 19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001d2e460c 20. /build/src/Common/PoolWithFailoverBase.h:286: PoolWithFailoverBase::getMany(unsigned long, unsigned long, unsigned long, unsigned long, bool, bool, std::function::TryResult (std::shared_ptr const&, String&)> const&, std::function const&) @ 0x000000001d2e01c9 21. /build/src/Client/ConnectionPoolWithFailover.cpp:222: DB::ConnectionPoolWithFailover::getManyImpl(DB::Settings const&, DB::PoolMode, std::function::TryResult (std::shared_ptr const&, String&)> const&, std::optional, std::function, bool) @ 0x000000001d2dc9e5 22. /build/src/Client/ConnectionPoolWithFailover.cpp:170: DB::ConnectionPoolWithFailover::getManyCheckedForInsert(DB::ConnectionTimeouts const&, DB::Settings const&, DB::PoolMode, DB::QualifiedTableName const&) @ 0x000000001d2dce34 23. /build/src/Storages/Distributed/DistributedAsyncInsertDirectoryQueue.cpp:415: DB::DistributedAsyncInsertDirectoryQueue::processFile(String&, DB::SettingsChanges const&) @ 0x000000001ca20d10 24. /build/src/Storages/Distributed/DistributedAsyncInsertDirectoryQueue.cpp:374: DB::DistributedAsyncInsertDirectoryQueue::processFiles(DB::SettingsChanges const&) @ 0x000000001ca1cb26 25. /build/src/Storages/Distributed/DistributedAsyncInsertDirectoryQueue.cpp:157: DB::DistributedAsyncInsertDirectoryQueue::flushAllData(DB::SettingsChanges const&) @ 0x000000001ca1c8e0 26. /build/src/Storages/StorageDistributed.cpp:1759: DB::StorageDistributed::flushClusterNodesAllDataImpl(std::shared_ptr, DB::SettingsChanges const&, bool)::$_0::operator()() const @ 0x000000001c34b069 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c34b035 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c34b015 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c34aff5 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c34afc0 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 2024.12.16 11:00:07.953481 [ 2758 ] {} Access(user directories): from: ::ffff:127.0.0.1, user: default: Authentication failed: Code: 193. DB::Exception: Invalid credentials. (WRONG_PASSWORD), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f4eb7 6. /build/src/Access/IAccessStorage.cpp:763: DB::IAccessStorage::throwInvalidCredentials() @ 0x000000001962d15b 7. /build/src/Access/IAccessStorage.cpp:537: DB::IAccessStorage::authenticateImpl(DB::Credentials const&, Poco::Net::IPAddress const&, DB::ExternalAuthenticators const&, bool, bool, bool) const @ 0x000000001962ce1d 8. /build/src/Access/IAccessStorage.cpp:511: DB::IAccessStorage::authenticate(DB::Credentials const&, Poco::Net::IPAddress const&, DB::ExternalAuthenticators const&, bool, bool, bool) const @ 0x000000001962cbd3 9. /build/src/Access/MultipleAccessStorage.cpp:451: DB::MultipleAccessStorage::authenticateImpl(DB::Credentials const&, Poco::Net::IPAddress const&, DB::ExternalAuthenticators const&, bool, bool, bool) const @ 0x00000000196c148a 10. /build/src/Access/IAccessStorage.cpp:499: DB::IAccessStorage::authenticate(DB::Credentials const&, Poco::Net::IPAddress const&, DB::ExternalAuthenticators const&, bool, bool) const @ 0x000000001962cb08 11. /build/src/Access/AccessControl.cpp:600: DB::AccessControl::authenticate(DB::Credentials const&, Poco::Net::IPAddress const&, String const&) const @ 0x00000000194d065a 12. /build/src/Interpreters/Session.cpp:352: DB::Session::authenticate(DB::Credentials const&, Poco::Net::SocketAddress const&) @ 0x000000001b8b2b47 13. /build/src/Interpreters/Session.cpp:332: DB::Session::authenticate(String const&, String const&, Poco::Net::SocketAddress const&) @ 0x000000001b8b1e49 14. /build/src/Server/TCPHandler.cpp:1532: DB::TCPHandler::receiveHello() @ 0x000000001d478a8f 15. /build/src/Server/TCPHandler.cpp:271: DB::TCPHandler::runImpl() @ 0x000000001d46cd2a 16. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 17. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 18. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 19. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 20. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 21. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 22. ? @ 0x00007f713a222ac3 23. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:07.983320 [ 2758 ] {} ServerErrorHandler: Code: 516. DB::Exception: default: Authentication failed: password is incorrect, or there is no user with such name. If you have installed ClickHouse and forgot password you can reset it in the configuration file. The password for default user is typically located at /etc/clickhouse-server/users.d/default-password.xml and deleting this file will reset the password. See also /etc/clickhouse-server/users.xml on the server where ClickHouse is installed. . (AUTHENTICATION_FAILED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:66: DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000af5f1e9 6. /build/src/Access/AccessControl.cpp:625: DB::AccessControl::authenticate(DB::Credentials const&, Poco::Net::IPAddress const&, String const&) const @ 0x00000000194d0af9 7. /build/src/Interpreters/Session.cpp:352: DB::Session::authenticate(DB::Credentials const&, Poco::Net::SocketAddress const&) @ 0x000000001b8b2b47 8. /build/src/Interpreters/Session.cpp:332: DB::Session::authenticate(String const&, String const&, Poco::Net::SocketAddress const&) @ 0x000000001b8b1e49 9. /build/src/Server/TCPHandler.cpp:1532: DB::TCPHandler::receiveHello() @ 0x000000001d478a8f 10. /build/src/Server/TCPHandler.cpp:271: DB::TCPHandler::runImpl() @ 0x000000001d46cd2a 11. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 12. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 13. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 14. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 15. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 16. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 17. ? @ 0x00007f713a222ac3 18. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:08.415553 [ 3021 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:08.419218 [ 3396 ] {} test_87w7g7ko.dist_01555.DistributedInsertQueue.default: Code: 516. DB::Exception: Received from 127.0.0.2:9000. DB::Exception: default: Authentication failed: password is incorrect, or there is no user with such name. If you have installed ClickHouse and forgot password you can reset it in the configuration file. The password for default user is typically located at /etc/clickhouse-server/users.d/default-password.xml and deleting this file will reset the password. See also /etc/clickhouse-server/users.xml on the server where ClickHouse is installed. . Stack trace: 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:66: DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000af5f1e9 6. /build/src/Access/AccessControl.cpp:625: DB::AccessControl::authenticate(DB::Credentials const&, Poco::Net::IPAddress const&, String const&) const @ 0x00000000194d0af9 7. /build/src/Interpreters/Session.cpp:352: DB::Session::authenticate(DB::Credentials const&, Poco::Net::SocketAddress const&) @ 0x000000001b8b2b47 8. /build/src/Interpreters/Session.cpp:332: DB::Session::authenticate(String const&, String const&, Poco::Net::SocketAddress const&) @ 0x000000001b8b1e49 9. /build/src/Server/TCPHandler.cpp:1532: DB::TCPHandler::receiveHello() @ 0x000000001d478a8f 10. /build/src/Server/TCPHandler.cpp:271: DB::TCPHandler::runImpl() @ 0x000000001d46cd2a 11. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 12. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 13. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 14. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 15. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 16. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 17. ? @ 0x00007f713a222ac3 18. ? @ 0x00007f713a2b4850 : While sending /var/lib/clickhouse/store/4c8/4c8c8318-c4bc-40eb-8c5f-dfef2373873b/default:foo@127%2E0%2E0%2E1:9000,default:foo@127%2E0%2E0%2E2:9000/1.bin. (AUTHENTICATION_FAILED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:89: DB::Exception::Exception(String const&, int, bool) @ 0x000000000a942caa 5. /build/src/Common/Exception.h:97: DB::Exception::createDeprecated(String const&, int, bool) @ 0x000000000a942c55 6. /build/src/IO/ReadHelpers.cpp:1560: DB::readException(DB::ReadBuffer&, String const&, bool) @ 0x0000000013369f82 7. /build/src/Client/Connection.cpp:1233: DB::Connection::receiveException() const @ 0x000000001d2bdc59 8. /build/src/Client/Connection.cpp:452: DB::Connection::receiveHello(Poco::Timespan const&) @ 0x000000001d2bd125 9. /build/src/Client/Connection.cpp:200: DB::Connection::connect(DB::ConnectionTimeouts const&) @ 0x000000001d2bb571 10. /build/src/Client/Connection.cpp:541: DB::Connection::forceConnected(DB::ConnectionTimeouts const&) @ 0x000000001d2be7c2 11. /build/src/Client/ConnectionEstablisher.cpp:48: DB::ConnectionEstablisher::run(PoolWithFailoverBase::TryResult&, String&) @ 0x000000001d2d150f 12. /build/src/Client/ConnectionPoolWithFailover.cpp:259: DB::ConnectionPoolWithFailover::tryGetEntry(std::shared_ptr const&, DB::ConnectionTimeouts const&, String&, DB::Settings const&, DB::QualifiedTableName const*, std::function) @ 0x000000001d2dd2b1 13. /build/src/Client/ConnectionPoolWithFailover.cpp:168: DB::ConnectionPoolWithFailover::getManyCheckedForInsert(DB::ConnectionTimeouts const&, DB::Settings const&, DB::PoolMode, DB::QualifiedTableName const&)::$_0::operator()(std::shared_ptr const&, String&) const @ 0x000000001d2deef7 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d2dee4c 15. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001d2dee0c 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d2dedcc 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d2ded77 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001d2e4f8d 19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001d2e460c 20. /build/src/Common/PoolWithFailoverBase.h:286: PoolWithFailoverBase::getMany(unsigned long, unsigned long, unsigned long, unsigned long, bool, bool, std::function::TryResult (std::shared_ptr const&, String&)> const&, std::function const&) @ 0x000000001d2e01c9 21. /build/src/Client/ConnectionPoolWithFailover.cpp:222: DB::ConnectionPoolWithFailover::getManyImpl(DB::Settings const&, DB::PoolMode, std::function::TryResult (std::shared_ptr const&, String&)> const&, std::optional, std::function, bool) @ 0x000000001d2dc9e5 22. /build/src/Client/ConnectionPoolWithFailover.cpp:170: DB::ConnectionPoolWithFailover::getManyCheckedForInsert(DB::ConnectionTimeouts const&, DB::Settings const&, DB::PoolMode, DB::QualifiedTableName const&) @ 0x000000001d2dce34 23. /build/src/Storages/Distributed/DistributedAsyncInsertDirectoryQueue.cpp:415: DB::DistributedAsyncInsertDirectoryQueue::processFile(String&, DB::SettingsChanges const&) @ 0x000000001ca20d10 24. /build/src/Storages/Distributed/DistributedAsyncInsertDirectoryQueue.cpp:374: DB::DistributedAsyncInsertDirectoryQueue::processFiles(DB::SettingsChanges const&) @ 0x000000001ca1cb26 25. /build/src/Storages/Distributed/DistributedAsyncInsertDirectoryQueue.cpp:200: DB::DistributedAsyncInsertDirectoryQueue::run() @ 0x000000001ca1cff5 26. /build/src/Storages/Distributed/DistributedAsyncInsertDirectoryQueue.cpp:135: DB::DistributedAsyncInsertDirectoryQueue::DistributedAsyncInsertDirectoryQueue(DB::StorageDistributed&, std::shared_ptr const&, String const&, std::shared_ptr, DB::ActionBlocker&, DB::BackgroundSchedulePool&)::$_0::operator()() const @ 0x000000001ca244d8 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ca244b5 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ca24495 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ca24475 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ca2443d 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:09.063571 [ 3670 ] {51e8a3ec-84df-41f0-a6b6-f0e53fb340e4} executeQuery: Code: 60. DB::Exception: Could not find table: t1. (UNKNOWN_TABLE) (version 24.3.12.76.altinitystable) (from 0.0.0.0:0) (comment: 01671_ddl_hang_timeout_long.sh) (in query: /* ddl_entry=query-0000000007 */ ALTER TABLE test_r3um35dq.t1 ADD COLUMN `newcol` UInt32), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&) @ 0x000000000a942753 6. /build/src/Interpreters/InterpreterAlterQuery.cpp:124: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff90e8 7. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff7cde 8. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 9. /build/src/Interpreters/executeQuery.cpp:1496: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb4e89 10. /build/src/Interpreters/DDLWorker.cpp:497: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000001a652a89 11. /build/src/Interpreters/DDLWorker.cpp:847: DB::DDLWorker::tryExecuteQueryOnLeaderReplica(DB::DDLTaskBase&, std::shared_ptr, String const&, std::shared_ptr const&, std::unique_ptr>&) @ 0x000000001a657833 12. /build/src/Interpreters/DDLWorker.cpp:656: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000001a651754 13. /build/src/Interpreters/DDLWorker.cpp:439: DB::DDLWorker::scheduleTasks(bool) @ 0x000000001a64f282 14. /build/src/Interpreters/DDLWorker.cpp:1147: DB::DDLWorker::runMainThread() @ 0x000000001a645293 15. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000001a665dc9 16. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&, 0ul>(void (DB::DDLWorker::*&)(), std::tuple&, std::__tuple_indices<0ul>) @ 0x000000001a665d4d 17. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(void (DB::DDLWorker::*&)(), std::tuple&) @ 0x000000001a665c9d 18. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::DDLWorker::*&&)(), DB::DDLWorker*&&)::'lambda'()::operator()() @ 0x000000001a665bb5 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a665b15 20. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a665af5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a665ad5 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a665aa0 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 25. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 26. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 28. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 29. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 30. ? @ 0x00007f713a222ac3 31. ? @ 0x00007f713a2b4850 2024.12.16 11:00:09.079075 [ 3670 ] {51e8a3ec-84df-41f0-a6b6-f0e53fb340e4} DDLWorker: Query /* ddl_entry=query-0000000007 */ ALTER TABLE test_r3um35dq.t1 ADD COLUMN `newcol` UInt32 wasn't finished successfully: Code: 60. DB::Exception: Could not find table: t1. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&) @ 0x000000000a942753 6. /build/src/Interpreters/InterpreterAlterQuery.cpp:124: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff90e8 7. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff7cde 8. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 9. /build/src/Interpreters/executeQuery.cpp:1496: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb4e89 10. /build/src/Interpreters/DDLWorker.cpp:497: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000001a652a89 11. /build/src/Interpreters/DDLWorker.cpp:847: DB::DDLWorker::tryExecuteQueryOnLeaderReplica(DB::DDLTaskBase&, std::shared_ptr, String const&, std::shared_ptr const&, std::unique_ptr>&) @ 0x000000001a657833 12. /build/src/Interpreters/DDLWorker.cpp:656: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000001a651754 13. /build/src/Interpreters/DDLWorker.cpp:439: DB::DDLWorker::scheduleTasks(bool) @ 0x000000001a64f282 14. /build/src/Interpreters/DDLWorker.cpp:1147: DB::DDLWorker::runMainThread() @ 0x000000001a645293 15. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000001a665dc9 16. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&, 0ul>(void (DB::DDLWorker::*&)(), std::tuple&, std::__tuple_indices<0ul>) @ 0x000000001a665d4d 17. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(void (DB::DDLWorker::*&)(), std::tuple&) @ 0x000000001a665c9d 18. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::DDLWorker::*&&)(), DB::DDLWorker*&&)::'lambda'()::operator()() @ 0x000000001a665bb5 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a665b15 20. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a665af5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a665ad5 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a665aa0 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 25. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 26. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 28. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 29. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 30. ? @ 0x00007f713a222ac3 31. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:09.260434 [ 2758 ] {} Access(user directories): from: ::ffff:127.0.0.1, user: default: Authentication failed: Code: 193. DB::Exception: Invalid credentials. (WRONG_PASSWORD), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f4eb7 6. /build/src/Access/IAccessStorage.cpp:763: DB::IAccessStorage::throwInvalidCredentials() @ 0x000000001962d15b 7. /build/src/Access/IAccessStorage.cpp:537: DB::IAccessStorage::authenticateImpl(DB::Credentials const&, Poco::Net::IPAddress const&, DB::ExternalAuthenticators const&, bool, bool, bool) const @ 0x000000001962ce1d 8. /build/src/Access/IAccessStorage.cpp:511: DB::IAccessStorage::authenticate(DB::Credentials const&, Poco::Net::IPAddress const&, DB::ExternalAuthenticators const&, bool, bool, bool) const @ 0x000000001962cbd3 9. /build/src/Access/MultipleAccessStorage.cpp:451: DB::MultipleAccessStorage::authenticateImpl(DB::Credentials const&, Poco::Net::IPAddress const&, DB::ExternalAuthenticators const&, bool, bool, bool) const @ 0x00000000196c148a 10. /build/src/Access/IAccessStorage.cpp:499: DB::IAccessStorage::authenticate(DB::Credentials const&, Poco::Net::IPAddress const&, DB::ExternalAuthenticators const&, bool, bool) const @ 0x000000001962cb08 11. /build/src/Access/AccessControl.cpp:600: DB::AccessControl::authenticate(DB::Credentials const&, Poco::Net::IPAddress const&, String const&) const @ 0x00000000194d065a 12. /build/src/Interpreters/Session.cpp:352: DB::Session::authenticate(DB::Credentials const&, Poco::Net::SocketAddress const&) @ 0x000000001b8b2b47 13. /build/src/Interpreters/Session.cpp:332: DB::Session::authenticate(String const&, String const&, Poco::Net::SocketAddress const&) @ 0x000000001b8b1e49 14. /build/src/Server/TCPHandler.cpp:1532: DB::TCPHandler::receiveHello() @ 0x000000001d478a8f 15. /build/src/Server/TCPHandler.cpp:271: DB::TCPHandler::runImpl() @ 0x000000001d46cd2a 16. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 17. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 18. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 19. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 20. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 21. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 22. ? @ 0x00007f713a222ac3 23. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:09.269090 [ 3397 ] {} test_87w7g7ko.dist_01555.DistributedInsertQueue.default: Code: 516. DB::Exception: Received from 127.0.0.1:9000. DB::Exception: default: Authentication failed: password is incorrect, or there is no user with such name. If you have installed ClickHouse and forgot password you can reset it in the configuration file. The password for default user is typically located at /etc/clickhouse-server/users.d/default-password.xml and deleting this file will reset the password. See also /etc/clickhouse-server/users.xml on the server where ClickHouse is installed. . Stack trace: 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:66: DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000af5f1e9 6. /build/src/Access/AccessControl.cpp:625: DB::AccessControl::authenticate(DB::Credentials const&, Poco::Net::IPAddress const&, String const&) const @ 0x00000000194d0af9 7. /build/src/Interpreters/Session.cpp:352: DB::Session::authenticate(DB::Credentials const&, Poco::Net::SocketAddress const&) @ 0x000000001b8b2b47 8. /build/src/Interpreters/Session.cpp:332: DB::Session::authenticate(String const&, String const&, Poco::Net::SocketAddress const&) @ 0x000000001b8b1e49 9. /build/src/Server/TCPHandler.cpp:1532: DB::TCPHandler::receiveHello() @ 0x000000001d478a8f 10. /build/src/Server/TCPHandler.cpp:271: DB::TCPHandler::runImpl() @ 0x000000001d46cd2a 11. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 12. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 13. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 14. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 15. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 16. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 17. ? @ 0x00007f713a222ac3 18. ? @ 0x00007f713a2b4850 : While sending /var/lib/clickhouse/store/4c8/4c8c8318-c4bc-40eb-8c5f-dfef2373873b/default:foo@127%2E0%2E0%2E1:9000,default:foo@127%2E0%2E0%2E2:9000/1.bin. (AUTHENTICATION_FAILED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:89: DB::Exception::Exception(String const&, int, bool) @ 0x000000000a942caa 5. /build/src/Common/Exception.h:97: DB::Exception::createDeprecated(String const&, int, bool) @ 0x000000000a942c55 6. /build/src/IO/ReadHelpers.cpp:1560: DB::readException(DB::ReadBuffer&, String const&, bool) @ 0x0000000013369f82 7. /build/src/Client/Connection.cpp:1233: DB::Connection::receiveException() const @ 0x000000001d2bdc59 8. /build/src/Client/Connection.cpp:452: DB::Connection::receiveHello(Poco::Timespan const&) @ 0x000000001d2bd125 9. /build/src/Client/Connection.cpp:200: DB::Connection::connect(DB::ConnectionTimeouts const&) @ 0x000000001d2bb571 10. /build/src/Client/Connection.cpp:541: DB::Connection::forceConnected(DB::ConnectionTimeouts const&) @ 0x000000001d2be7c2 11. /build/src/Client/ConnectionEstablisher.cpp:48: DB::ConnectionEstablisher::run(PoolWithFailoverBase::TryResult&, String&) @ 0x000000001d2d150f 12. /build/src/Client/ConnectionPoolWithFailover.cpp:259: DB::ConnectionPoolWithFailover::tryGetEntry(std::shared_ptr const&, DB::ConnectionTimeouts const&, String&, DB::Settings const&, DB::QualifiedTableName const*, std::function) @ 0x000000001d2dd2b1 13. /build/src/Client/ConnectionPoolWithFailover.cpp:168: DB::ConnectionPoolWithFailover::getManyCheckedForInsert(DB::ConnectionTimeouts const&, DB::Settings const&, DB::PoolMode, DB::QualifiedTableName const&)::$_0::operator()(std::shared_ptr const&, String&) const @ 0x000000001d2deef7 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d2dee4c 15. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001d2dee0c 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d2dedcc 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d2ded77 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001d2e4f8d 19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001d2e460c 20. /build/src/Common/PoolWithFailoverBase.h:286: PoolWithFailoverBase::getMany(unsigned long, unsigned long, unsigned long, unsigned long, bool, bool, std::function::TryResult (std::shared_ptr const&, String&)> const&, std::function const&) @ 0x000000001d2e01c9 21. /build/src/Client/ConnectionPoolWithFailover.cpp:222: DB::ConnectionPoolWithFailover::getManyImpl(DB::Settings const&, DB::PoolMode, std::function::TryResult (std::shared_ptr const&, String&)> const&, std::optional, std::function, bool) @ 0x000000001d2dc9e5 22. /build/src/Client/ConnectionPoolWithFailover.cpp:170: DB::ConnectionPoolWithFailover::getManyCheckedForInsert(DB::ConnectionTimeouts const&, DB::Settings const&, DB::PoolMode, DB::QualifiedTableName const&) @ 0x000000001d2dce34 23. /build/src/Storages/Distributed/DistributedAsyncInsertDirectoryQueue.cpp:415: DB::DistributedAsyncInsertDirectoryQueue::processFile(String&, DB::SettingsChanges const&) @ 0x000000001ca20d10 24. /build/src/Storages/Distributed/DistributedAsyncInsertDirectoryQueue.cpp:374: DB::DistributedAsyncInsertDirectoryQueue::processFiles(DB::SettingsChanges const&) @ 0x000000001ca1cb26 25. /build/src/Storages/Distributed/DistributedAsyncInsertDirectoryQueue.cpp:200: DB::DistributedAsyncInsertDirectoryQueue::run() @ 0x000000001ca1cff5 26. /build/src/Storages/Distributed/DistributedAsyncInsertDirectoryQueue.cpp:135: DB::DistributedAsyncInsertDirectoryQueue::DistributedAsyncInsertDirectoryQueue(DB::StorageDistributed&, std::shared_ptr const&, String const&, std::shared_ptr, DB::ActionBlocker&, DB::BackgroundSchedulePool&)::$_0::operator()() const @ 0x000000001ca244d8 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ca244b5 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ca24495 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ca24475 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ca2443d 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:09.268307 [ 2758 ] {} ServerErrorHandler: Code: 516. DB::Exception: default: Authentication failed: password is incorrect, or there is no user with such name. If you have installed ClickHouse and forgot password you can reset it in the configuration file. The password for default user is typically located at /etc/clickhouse-server/users.d/default-password.xml and deleting this file will reset the password. See also /etc/clickhouse-server/users.xml on the server where ClickHouse is installed. . (AUTHENTICATION_FAILED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:66: DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000af5f1e9 6. /build/src/Access/AccessControl.cpp:625: DB::AccessControl::authenticate(DB::Credentials const&, Poco::Net::IPAddress const&, String const&) const @ 0x00000000194d0af9 7. /build/src/Interpreters/Session.cpp:352: DB::Session::authenticate(DB::Credentials const&, Poco::Net::SocketAddress const&) @ 0x000000001b8b2b47 8. /build/src/Interpreters/Session.cpp:332: DB::Session::authenticate(String const&, String const&, Poco::Net::SocketAddress const&) @ 0x000000001b8b1e49 9. /build/src/Server/TCPHandler.cpp:1532: DB::TCPHandler::receiveHello() @ 0x000000001d478a8f 10. /build/src/Server/TCPHandler.cpp:271: DB::TCPHandler::runImpl() @ 0x000000001d46cd2a 11. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 12. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 13. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 14. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 15. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 16. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 17. ? @ 0x00007f713a222ac3 18. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:09.426896 [ 3091 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:09.459534 [ 4182 ] {a732e05f-7d92-4ba9-8bc6-ef0e77396b00} executeQuery: Code: 60. DB::Exception: There was an error on [localhost:9000]: Code: 60. DB::Exception: Could not find table: t1. (UNKNOWN_TABLE) (version 24.3.12.76.altinitystable). (UNKNOWN_TABLE) (version 24.3.12.76.altinitystable) (from [::1]:50180) (comment: 01671_ddl_hang_timeout_long.sh) (in query: ALTER TABLE test_r3um35dq.t1 on cluster test_shard_localhost ADD COLUMN newcol UInt32), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&, unsigned short&, String&) @ 0x000000001bb9f708 6. /build/src/Interpreters/executeDDLQueryOnCluster.cpp:574: DB::DDLQueryStatusSource::generate() @ 0x000000001bb99fe3 7. /build/src/Processors/ISource.cpp:139: DB::ISource::tryGenerate() @ 0x000000001d4f7ed0 8. /build/src/Processors/ISource.cpp:108: DB::ISource::work() @ 0x000000001d4f7bb6 9. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 10. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 11. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 12. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 13. /build/src/Processors/Executors/PipelineExecutor.cpp:411: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514ed5 14. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 15. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 16. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 18. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 19. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 20. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 27. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 28. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 30. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 31. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 2024.12.16 11:00:09.460265 [ 2758 ] {} Access(user directories): from: ::ffff:127.0.0.1, user: default: Authentication failed: Code: 193. DB::Exception: Invalid credentials. (WRONG_PASSWORD), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f4eb7 6. /build/src/Access/IAccessStorage.cpp:763: DB::IAccessStorage::throwInvalidCredentials() @ 0x000000001962d15b 7. /build/src/Access/IAccessStorage.cpp:537: DB::IAccessStorage::authenticateImpl(DB::Credentials const&, Poco::Net::IPAddress const&, DB::ExternalAuthenticators const&, bool, bool, bool) const @ 0x000000001962ce1d 8. /build/src/Access/IAccessStorage.cpp:511: DB::IAccessStorage::authenticate(DB::Credentials const&, Poco::Net::IPAddress const&, DB::ExternalAuthenticators const&, bool, bool, bool) const @ 0x000000001962cbd3 9. /build/src/Access/MultipleAccessStorage.cpp:451: DB::MultipleAccessStorage::authenticateImpl(DB::Credentials const&, Poco::Net::IPAddress const&, DB::ExternalAuthenticators const&, bool, bool, bool) const @ 0x00000000196c148a 10. /build/src/Access/IAccessStorage.cpp:499: DB::IAccessStorage::authenticate(DB::Credentials const&, Poco::Net::IPAddress const&, DB::ExternalAuthenticators const&, bool, bool) const @ 0x000000001962cb08 11. /build/src/Access/AccessControl.cpp:600: DB::AccessControl::authenticate(DB::Credentials const&, Poco::Net::IPAddress const&, String const&) const @ 0x00000000194d065a 12. /build/src/Interpreters/Session.cpp:352: DB::Session::authenticate(DB::Credentials const&, Poco::Net::SocketAddress const&) @ 0x000000001b8b2b47 13. /build/src/Interpreters/Session.cpp:332: DB::Session::authenticate(String const&, String const&, Poco::Net::SocketAddress const&) @ 0x000000001b8b1e49 14. /build/src/Server/TCPHandler.cpp:1532: DB::TCPHandler::receiveHello() @ 0x000000001d478a8f 15. /build/src/Server/TCPHandler.cpp:271: DB::TCPHandler::runImpl() @ 0x000000001d46cd2a 16. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 17. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 18. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 19. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 20. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 21. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 22. ? @ 0x00007f713a222ac3 23. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:09.469636 [ 4182 ] {a732e05f-7d92-4ba9-8bc6-ef0e77396b00} TCPHandler: Code: 60. DB::Exception: There was an error on [localhost:9000]: Code: 60. DB::Exception: Could not find table: t1. (UNKNOWN_TABLE) (version 24.3.12.76.altinitystable). (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&, unsigned short&, String&) @ 0x000000001bb9f708 6. /build/src/Interpreters/executeDDLQueryOnCluster.cpp:574: DB::DDLQueryStatusSource::generate() @ 0x000000001bb99fe3 7. /build/src/Processors/ISource.cpp:139: DB::ISource::tryGenerate() @ 0x000000001d4f7ed0 8. /build/src/Processors/ISource.cpp:108: DB::ISource::work() @ 0x000000001d4f7bb6 9. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 10. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 11. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 12. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 13. /build/src/Processors/Executors/PipelineExecutor.cpp:411: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514ed5 14. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 15. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 16. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 18. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 19. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 20. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 27. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 28. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 30. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 31. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 2024.12.16 11:00:09.475336 [ 4401 ] {26c0382e-fefc-44af-9563-d78cf3f6ed08} StorageDistributed (dist_01555): Cannot flush: Code: 516. DB::Exception: Received from 127.0.0.2:9000. DB::Exception: default: Authentication failed: password is incorrect, or there is no user with such name. If you have installed ClickHouse and forgot password you can reset it in the configuration file. The password for default user is typically located at /etc/clickhouse-server/users.d/default-password.xml and deleting this file will reset the password. See also /etc/clickhouse-server/users.xml on the server where ClickHouse is installed. . Stack trace: 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:66: DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000af5f1e9 6. /build/src/Access/AccessControl.cpp:625: DB::AccessControl::authenticate(DB::Credentials const&, Poco::Net::IPAddress const&, String const&) const @ 0x00000000194d0af9 7. /build/src/Interpreters/Session.cpp:352: DB::Session::authenticate(DB::Credentials const&, Poco::Net::SocketAddress const&) @ 0x000000001b8b2b47 8. /build/src/Interpreters/Session.cpp:332: DB::Session::authenticate(String const&, String const&, Poco::Net::SocketAddress const&) @ 0x000000001b8b1e49 9. /build/src/Server/TCPHandler.cpp:1532: DB::TCPHandler::receiveHello() @ 0x000000001d478a8f 10. /build/src/Server/TCPHandler.cpp:271: DB::TCPHandler::runImpl() @ 0x000000001d46cd2a 11. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 12. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 13. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 14. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 15. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 16. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 17. ? @ 0x00007f713a222ac3 18. ? @ 0x00007f713a2b4850 : While sending /var/lib/clickhouse/store/4c8/4c8c8318-c4bc-40eb-8c5f-dfef2373873b/default:foo@127%2E0%2E0%2E1:9000,default:foo@127%2E0%2E0%2E2:9000/1.bin. (AUTHENTICATION_FAILED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:89: DB::Exception::Exception(String const&, int, bool) @ 0x000000000a942caa 5. /build/src/Common/Exception.h:97: DB::Exception::createDeprecated(String const&, int, bool) @ 0x000000000a942c55 6. /build/src/IO/ReadHelpers.cpp:1560: DB::readException(DB::ReadBuffer&, String const&, bool) @ 0x0000000013369f82 7. /build/src/Client/Connection.cpp:1233: DB::Connection::receiveException() const @ 0x000000001d2bdc59 8. /build/src/Client/Connection.cpp:452: DB::Connection::receiveHello(Poco::Timespan const&) @ 0x000000001d2bd125 9. /build/src/Client/Connection.cpp:200: DB::Connection::connect(DB::ConnectionTimeouts const&) @ 0x000000001d2bb571 10. /build/src/Client/Connection.cpp:541: DB::Connection::forceConnected(DB::ConnectionTimeouts const&) @ 0x000000001d2be7c2 11. /build/src/Client/ConnectionEstablisher.cpp:48: DB::ConnectionEstablisher::run(PoolWithFailoverBase::TryResult&, String&) @ 0x000000001d2d150f 12. /build/src/Client/ConnectionPoolWithFailover.cpp:259: DB::ConnectionPoolWithFailover::tryGetEntry(std::shared_ptr const&, DB::ConnectionTimeouts const&, String&, DB::Settings const&, DB::QualifiedTableName const*, std::function) @ 0x000000001d2dd2b1 13. /build/src/Client/ConnectionPoolWithFailover.cpp:168: DB::ConnectionPoolWithFailover::getManyCheckedForInsert(DB::ConnectionTimeouts const&, DB::Settings const&, DB::PoolMode, DB::QualifiedTableName const&)::$_0::operator()(std::shared_ptr const&, String&) const @ 0x000000001d2deef7 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d2dee4c 15. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001d2dee0c 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d2dedcc 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d2ded77 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001d2e4f8d 19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001d2e460c 20. /build/src/Common/PoolWithFailoverBase.h:286: PoolWithFailoverBase::getMany(unsigned long, unsigned long, unsigned long, unsigned long, bool, bool, std::function::TryResult (std::shared_ptr const&, String&)> const&, std::function const&) @ 0x000000001d2e01c9 21. /build/src/Client/ConnectionPoolWithFailover.cpp:222: DB::ConnectionPoolWithFailover::getManyImpl(DB::Settings const&, DB::PoolMode, std::function::TryResult (std::shared_ptr const&, String&)> const&, std::optional, std::function, bool) @ 0x000000001d2dc9e5 22. /build/src/Client/ConnectionPoolWithFailover.cpp:170: DB::ConnectionPoolWithFailover::getManyCheckedForInsert(DB::ConnectionTimeouts const&, DB::Settings const&, DB::PoolMode, DB::QualifiedTableName const&) @ 0x000000001d2dce34 23. /build/src/Storages/Distributed/DistributedAsyncInsertDirectoryQueue.cpp:415: DB::DistributedAsyncInsertDirectoryQueue::processFile(String&, DB::SettingsChanges const&) @ 0x000000001ca20d10 24. /build/src/Storages/Distributed/DistributedAsyncInsertDirectoryQueue.cpp:374: DB::DistributedAsyncInsertDirectoryQueue::processFiles(DB::SettingsChanges const&) @ 0x000000001ca1cb26 25. /build/src/Storages/Distributed/DistributedAsyncInsertDirectoryQueue.cpp:157: DB::DistributedAsyncInsertDirectoryQueue::flushAllData(DB::SettingsChanges const&) @ 0x000000001ca1c8e0 26. /build/src/Storages/StorageDistributed.cpp:1759: DB::StorageDistributed::flushClusterNodesAllDataImpl(std::shared_ptr, DB::SettingsChanges const&, bool)::$_0::operator()() const @ 0x000000001c34b069 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c34b035 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c34b015 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c34aff5 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c34afc0 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:09.486770 [ 2758 ] {} ServerErrorHandler: Code: 516. DB::Exception: default: Authentication failed: password is incorrect, or there is no user with such name. If you have installed ClickHouse and forgot password you can reset it in the configuration file. The password for default user is typically located at /etc/clickhouse-server/users.d/default-password.xml and deleting this file will reset the password. See also /etc/clickhouse-server/users.xml on the server where ClickHouse is installed. . (AUTHENTICATION_FAILED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:66: DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000af5f1e9 6. /build/src/Access/AccessControl.cpp:625: DB::AccessControl::authenticate(DB::Credentials const&, Poco::Net::IPAddress const&, String const&) const @ 0x00000000194d0af9 7. /build/src/Interpreters/Session.cpp:352: DB::Session::authenticate(DB::Credentials const&, Poco::Net::SocketAddress const&) @ 0x000000001b8b2b47 8. /build/src/Interpreters/Session.cpp:332: DB::Session::authenticate(String const&, String const&, Poco::Net::SocketAddress const&) @ 0x000000001b8b1e49 9. /build/src/Server/TCPHandler.cpp:1532: DB::TCPHandler::receiveHello() @ 0x000000001d478a8f 10. /build/src/Server/TCPHandler.cpp:271: DB::TCPHandler::runImpl() @ 0x000000001d46cd2a 11. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 12. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 13. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 14. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 15. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 16. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 17. ? @ 0x00007f713a222ac3 18. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:09.781405 [ 3484 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {c55ac4aa-92c9-4d4b-932f-d2ce86c8486d::202412_1_41_8}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:294: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf3a8b6 21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37f43 23. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb722bf 24. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb725d8 25. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb71fb2 26. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13ef38 27. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x000000001cba15ed 28. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x000000001cba210e 29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef, StrongTypedef, std::basic_string_view>)::'lambda'()::operator()() const @ 0x000000001cba9c78 30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba9c55 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001cba9c35 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:10.156778 [ 5023 ] {b16a396a-076d-4eab-ac62-5833571f0cc8} DynamicQueryHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=13, jobs=13). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 13. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 14. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 15. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 16. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 17. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 18. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 19. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 20. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 21. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 22. ? @ 0x00007f713a222ac3 23. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:10.432683 [ 3101 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:11.368968 [ 6123 ] {fbfc4ea1-5e40-4b38-a990-8abf09245b33} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=2, jobs=2). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::ffff:127.0.0.1]:60514) (comment: 00159_parallel_formatting_http.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a,MobilePhoneModel as b,ClientIP6 as c FROM test.hits ORDER BY a,b,c LIMIT 1000000 Format CSV ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:748: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector, std::allocator>>&&, std::vector, std::allocator>>&&, std::shared_ptr, std::shared_ptr const&, DB::KeyCondition const&, std::optional const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, std::shared_ptr, unsigned long, std::vector>&, bool) @ 0x000000001cd10135 10. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1671: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector, std::allocator>>, std::vector, std::allocator>>, std::shared_ptr const&, DB::SelectQueryInfo const&, std::shared_ptr, unsigned long, std::shared_ptr, std::equal_to, std::allocator>>>, DB::MergeTreeData const&, std::vector> const&, std::shared_ptr, std::optional&) @ 0x000000001dd5ebc4 11. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1570: DB::ReadFromMergeTree::selectRangesToRead(std::vector, std::allocator>>, std::vector, std::allocator>>, std::shared_ptr const&, DB::SelectQueryInfo const&, std::shared_ptr, unsigned long, std::shared_ptr, std::equal_to, std::allocator>>>, DB::MergeTreeData const&, std::vector> const&, std::shared_ptr, std::optional&) @ 0x000000001dd5b86f 12. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1371: DB::ReadFromMergeTree::selectRangesToRead(std::vector, std::allocator>>, std::vector, std::allocator>>) const @ 0x000000001dd5b69e 13. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1854: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000001dd6148c 14. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1969: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd624fb 15. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector>, std::allocator>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd08c90 16. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3371f 17. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b508741 18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50849b 19. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 20. /build/src/Interpreters/executeQuery.cpp:1496: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb4e89 21. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 22. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 23. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 24. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 25. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 26. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 27. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 28. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 11:00:11.413284 [ 6123 ] {fbfc4ea1-5e40-4b38-a990-8abf09245b33} DynamicQueryHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=2, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:748: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector, std::allocator>>&&, std::vector, std::allocator>>&&, std::shared_ptr, std::shared_ptr const&, DB::KeyCondition const&, std::optional const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, std::shared_ptr, unsigned long, std::vector>&, bool) @ 0x000000001cd10135 10. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1671: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector, std::allocator>>, std::vector, std::allocator>>, std::shared_ptr const&, DB::SelectQueryInfo const&, std::shared_ptr, unsigned long, std::shared_ptr, std::equal_to, std::allocator>>>, DB::MergeTreeData const&, std::vector> const&, std::shared_ptr, std::optional&) @ 0x000000001dd5ebc4 11. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1570: DB::ReadFromMergeTree::selectRangesToRead(std::vector, std::allocator>>, std::vector, std::allocator>>, std::shared_ptr const&, DB::SelectQueryInfo const&, std::shared_ptr, unsigned long, std::shared_ptr, std::equal_to, std::allocator>>>, DB::MergeTreeData const&, std::vector> const&, std::shared_ptr, std::optional&) @ 0x000000001dd5b86f 12. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1371: DB::ReadFromMergeTree::selectRangesToRead(std::vector, std::allocator>>, std::vector, std::allocator>>) const @ 0x000000001dd5b69e 13. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1854: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000001dd6148c 14. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1969: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd624fb 15. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector>, std::allocator>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd08c90 16. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3371f 17. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b508741 18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50849b 19. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 20. /build/src/Interpreters/executeQuery.cpp:1496: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb4e89 21. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 22. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 23. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 24. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 25. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 26. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 27. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 28. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:11.443195 [ 3097 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:12.465669 [ 3122 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:13.478327 [ 3144 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:13.864192 [ 3670 ] {7679e028-af2b-4121-b3b5-076df9a0d1a9} executeQuery: Code: 60. DB::Exception: Could not find table: t1. (UNKNOWN_TABLE) (version 24.3.12.76.altinitystable) (from 0.0.0.0:0) (comment: 01671_ddl_hang_timeout_long.sh) (in query: /* ddl_entry=query-0000000008 */ ALTER TABLE test_r3um35dq.t1 ADD COLUMN `newcol` UInt32), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&) @ 0x000000000a942753 6. /build/src/Interpreters/InterpreterAlterQuery.cpp:124: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff90e8 7. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff7cde 8. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 9. /build/src/Interpreters/executeQuery.cpp:1496: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb4e89 10. /build/src/Interpreters/DDLWorker.cpp:497: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000001a652a89 11. /build/src/Interpreters/DDLWorker.cpp:661: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000001a651784 12. /build/src/Interpreters/DDLWorker.cpp:439: DB::DDLWorker::scheduleTasks(bool) @ 0x000000001a64f282 13. /build/src/Interpreters/DDLWorker.cpp:1147: DB::DDLWorker::runMainThread() @ 0x000000001a645293 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000001a665dc9 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&, 0ul>(void (DB::DDLWorker::*&)(), std::tuple&, std::__tuple_indices<0ul>) @ 0x000000001a665d4d 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(void (DB::DDLWorker::*&)(), std::tuple&) @ 0x000000001a665c9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::DDLWorker::*&&)(), DB::DDLWorker*&&)::'lambda'()::operator()() @ 0x000000001a665bb5 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a665b15 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a665af5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a665ad5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a665aa0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 11:00:13.884593 [ 3670 ] {7679e028-af2b-4121-b3b5-076df9a0d1a9} DDLWorker: Query /* ddl_entry=query-0000000008 */ ALTER TABLE test_r3um35dq.t1 ADD COLUMN `newcol` UInt32 wasn't finished successfully: Code: 60. DB::Exception: Could not find table: t1. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&) @ 0x000000000a942753 6. /build/src/Interpreters/InterpreterAlterQuery.cpp:124: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff90e8 7. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff7cde 8. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 9. /build/src/Interpreters/executeQuery.cpp:1496: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb4e89 10. /build/src/Interpreters/DDLWorker.cpp:497: DB::DDLWorker::tryExecuteQuery(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000001a652a89 11. /build/src/Interpreters/DDLWorker.cpp:661: DB::DDLWorker::processTask(DB::DDLTaskBase&, std::shared_ptr const&) @ 0x000000001a651784 12. /build/src/Interpreters/DDLWorker.cpp:439: DB::DDLWorker::scheduleTasks(bool) @ 0x000000001a64f282 13. /build/src/Interpreters/DDLWorker.cpp:1147: DB::DDLWorker::runMainThread() @ 0x000000001a645293 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000001a665dc9 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&, 0ul>(void (DB::DDLWorker::*&)(), std::tuple&, std::__tuple_indices<0ul>) @ 0x000000001a665d4d 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(void (DB::DDLWorker::*&)(), std::tuple&) @ 0x000000001a665c9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::DDLWorker::*&&)(), DB::DDLWorker*&&)::'lambda'()::operator()() @ 0x000000001a665bb5 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a665b15 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a665af5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a665ad5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a665aa0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:14.128945 [ 3751 ] {7fae247d-5aca-478f-b9e4-badf72361116} executeQuery: Code: 60. DB::Exception: There was an error on [localhost:9000]: Code: 60. DB::Exception: Could not find table: t1. (UNKNOWN_TABLE) (version 24.3.12.76.altinitystable). (UNKNOWN_TABLE) (version 24.3.12.76.altinitystable) (from [::1]:33322) (comment: 01671_ddl_hang_timeout_long.sh) (in query: ALTER TABLE test_r3um35dq.t1 on cluster test_shard_localhost ADD COLUMN newcol UInt32), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&, unsigned short&, String&) @ 0x000000001bb9f708 6. /build/src/Interpreters/executeDDLQueryOnCluster.cpp:574: DB::DDLQueryStatusSource::generate() @ 0x000000001bb99fe3 7. /build/src/Processors/ISource.cpp:139: DB::ISource::tryGenerate() @ 0x000000001d4f7ed0 8. /build/src/Processors/ISource.cpp:108: DB::ISource::work() @ 0x000000001d4f7bb6 9. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 10. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 11. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 12. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 13. /build/src/Processors/Executors/PipelineExecutor.cpp:411: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514ed5 14. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 15. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 16. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 18. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 19. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 20. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 27. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 28. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 30. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 31. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 2024.12.16 11:00:14.136235 [ 3751 ] {7fae247d-5aca-478f-b9e4-badf72361116} TCPHandler: Code: 60. DB::Exception: There was an error on [localhost:9000]: Code: 60. DB::Exception: Could not find table: t1. (UNKNOWN_TABLE) (version 24.3.12.76.altinitystable). (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&, unsigned short&, String&) @ 0x000000001bb9f708 6. /build/src/Interpreters/executeDDLQueryOnCluster.cpp:574: DB::DDLQueryStatusSource::generate() @ 0x000000001bb99fe3 7. /build/src/Processors/ISource.cpp:139: DB::ISource::tryGenerate() @ 0x000000001d4f7ed0 8. /build/src/Processors/ISource.cpp:108: DB::ISource::work() @ 0x000000001d4f7bb6 9. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 10. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 11. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 12. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 13. /build/src/Processors/Executors/PipelineExecutor.cpp:411: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514ed5 14. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 15. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 16. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 18. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 19. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 20. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 27. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 28. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 30. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 31. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 2024.12.16 11:00:14.500498 [ 3137 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:15.473127 [ 3855 ] {abbaf92d-9872-48f0-888c-7836fe6646e2} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=15, jobs=15). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:33354) (comment: 01083_window_view_select.sh) (in query: SELECT count(*) FROM wv), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 11:00:15.506671 [ 3165 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:15.545578 [ 3855 ] {abbaf92d-9872-48f0-888c-7836fe6646e2} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=15, jobs=15). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 11:00:16.576025 [ 3181 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:17.582875 [ 3186 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:18.586210 [ 3212 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:19.592872 [ 3224 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:20.283958 [ 6123 ] {85628c75-89be-4cfe-9e6c-29cfbfc8a864} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=17, jobs=17). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:44856) (comment: 01083_window_view_select.sh) (in query: SELECT count(*) FROM wv), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 11:00:20.315310 [ 6123 ] {85628c75-89be-4cfe-9e6c-29cfbfc8a864} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=17, jobs=17). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 11:00:20.601549 [ 3242 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:21.604736 [ 3257 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:22.198269 [ 3751 ] {1c092128-3bbc-4d0c-90f1-fabbd6d4732d} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=8, jobs=0). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:44866) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM system.processes WHERE query_id != queryID() AND current_database = currentDatabase() AND query LIKE '%-- 11317_tuple%'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 11:00:22.480085 [ 3751 ] {1c092128-3bbc-4d0c-90f1-fabbd6d4732d} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=8, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 11:00:22.616757 [ 3266 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:23.444570 [ 3493 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {3874c721-a658-4698-80d5-52c26fc35278::202412_1_56_11}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:298: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd2eaf 21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set, std::equal_to, std::allocator>&) @ 0x000000001ccd371a 22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf3803a 23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37f43 24. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb722bf 25. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb725d8 26. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb71fb2 27. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13ef38 28. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x000000001cba15ed 29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x000000001cba210e 30. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef, StrongTypedef, std::basic_string_view>)::'lambda'()::operator()() const @ 0x000000001cba9c78 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba9c55 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:23.623235 [ 3276 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:23.951400 [ 3552 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:310: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf3ab86 21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:24.056704 [ 4402 ] {f7b18f2a-7875-463b-ae70-d4bee7be0c83} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=3): While executing MergeTreeSelect(pool: ReadPoolInOrder, algorithm: InOrder). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::ffff:127.0.0.1]:60522) (comment: 00159_parallel_formatting_http.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a,MobilePhoneModel as b,ClientIP6 as c FROM test.hits ORDER BY a,b,c LIMIT 1000000 Format JSONCompactEachRow ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1fc91 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1fb3b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1faf0 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1fab0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1fa3b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce216d1 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1f750 16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future> DB::scheduleFromThreadPoolUnsafe, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl>&, String const&, Priority) @ 0x000000001ce1f09c 17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1d6c3 18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl>*, unsigned long) @ 0x000000001ce1d5b3 19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6eeac 20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, void, void>(std::allocator&, DB::MergeTreeMarksLoader*, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6edb5 21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int>(std::allocator, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6ece3 22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], std::shared_ptr&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, void>(std::allocator const&, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6eb95 23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, void>(std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6e49b 24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&, std::function const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bed3 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bbdd 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bb9d 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bb5d 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bb28 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd6a7e 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd2efd 31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fd02d6 2024.12.16 11:00:24.629442 [ 3291 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:25.418851 [ 3492 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {41d82839-5472-4425-b891-a2dc2a236577::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=40, jobs=0): (while reading column VisitID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/41d/41d82839-5472-4425-b891-a2dc2a236577/201403_5_5_0/ in table test.visits (41d82839-5472-4425-b891-a2dc2a236577) located on disk s3_disk of type s3, from mark 19 with max_rows_to_read = 6739): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe(ThreadPoolImpl>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e92e1 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e917b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e9130 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e90f0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e907b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190eadb1 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e8d90 16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future DB::scheduleFromThreadPoolUnsafe(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl>&, String const&, Priority) @ 0x00000000190e861c 17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e7e3f 18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019365312 19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936561e 20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddc44d 21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6d168 22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6cfbd 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6cf7d 24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6cf3d 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6cf08 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd6a7e 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd2efd 28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fd02d6 29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x0000000019fd045c 30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&) @ 0x000000001ce6ab9b 31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce6a910 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:25.631509 [ 3306 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:26.653147 [ 3318 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:26.819135 [ 4402 ] {f7b18f2a-7875-463b-ae70-d4bee7be0c83} DynamicQueryHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=3): While executing MergeTreeSelect(pool: ReadPoolInOrder, algorithm: InOrder). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1fc91 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1fb3b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1faf0 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1fab0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1fa3b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce216d1 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1f750 16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future> DB::scheduleFromThreadPoolUnsafe, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl>&, String const&, Priority) @ 0x000000001ce1f09c 17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1d6c3 18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl>*, unsigned long) @ 0x000000001ce1d5b3 19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6eeac 20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, void, void>(std::allocator&, DB::MergeTreeMarksLoader*, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6edb5 21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int>(std::allocator, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6ece3 22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], std::shared_ptr&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, void>(std::allocator const&, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6eb95 23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, void>(std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6e49b 24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&, std::function const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bed3 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bbdd 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bb9d 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bb5d 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bb28 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd6a7e 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd2efd 31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fd02d6 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:27.659244 [ 3333 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:28.542083 [ 3491 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {3874c721-a658-4698-80d5-52c26fc35278::202412_1_56_11}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:302: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf3a9cc 21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37f43 23. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb722bf 24. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb725d8 25. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb71fb2 26. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13ef38 27. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x000000001cba15ed 28. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x000000001cba210e 29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef, StrongTypedef, std::basic_string_view>)::'lambda'()::operator()() const @ 0x000000001cba9c78 30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba9c55 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001cba9c35 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:28.665864 [ 3346 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:29.668037 [ 3359 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:29.902648 [ 6123 ] {0c2aefc4-58ac-44fe-8677-b05bc7839924} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=31, jobs=31). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::ffff:127.0.0.1]:41124) (comment: 00159_parallel_formatting_http.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a,MobilePhoneModel as b,ClientIP6 as c FROM test.hits ORDER BY a,b,c LIMIT 1000000 Format JSONCompactEachRow ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 13. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 14. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 15. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 16. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 17. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 18. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 19. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 20. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 21. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 22. ? @ 0x00007f713a222ac3 23. ? @ 0x00007f713a2b4850 2024.12.16 11:00:30.099203 [ 4402 ] {cd9f85b6-9ee5-4e97-af13-ea632d305ba9} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=962, jobs=842). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:43660) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM system.processes WHERE query_id != queryID() AND current_database = currentDatabase() AND query LIKE '%-- 11317_tuple%'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133dc4ad 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d4458 8. /build/src/Common/ThreadPool.cpp:338: ThreadPoolImpl::scheduleOrThrow(std::function, Priority, unsigned long, bool) @ 0x00000000133d4d10 9. /build/src/Common/ThreadPool.h:205: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001d538cf3 10. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:112: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long) @ 0x000000001d538a34 11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:138: DB::PullingAsyncPipelineExecutor::pull(DB::Block&, unsigned long) @ 0x000000001d538de9 12. /build/src/Server/TCPHandler.cpp:1023: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d47ad7f 13. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d47005b 14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 20. ? @ 0x00007f713a222ac3 21. ? @ 0x00007f713a2b4850 2024.12.16 11:00:30.251558 [ 4402 ] {cd9f85b6-9ee5-4e97-af13-ea632d305ba9} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=962, jobs=842). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133dc4ad 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d4458 8. /build/src/Common/ThreadPool.cpp:338: ThreadPoolImpl::scheduleOrThrow(std::function, Priority, unsigned long, bool) @ 0x00000000133d4d10 9. /build/src/Common/ThreadPool.h:205: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001d538cf3 10. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:112: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long) @ 0x000000001d538a34 11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:138: DB::PullingAsyncPipelineExecutor::pull(DB::Block&, unsigned long) @ 0x000000001d538de9 12. /build/src/Server/TCPHandler.cpp:1023: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d47ad7f 13. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d47005b 14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 20. ? @ 0x00007f713a222ac3 21. ? @ 0x00007f713a2b4850 2024.12.16 11:00:30.677718 [ 3371 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:31.550872 [ 6123 ] {0c2aefc4-58ac-44fe-8677-b05bc7839924} DynamicQueryHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=31, jobs=31). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 13. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 14. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 15. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 16. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 17. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 18. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 19. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 20. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 21. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 22. ? @ 0x00007f713a222ac3 23. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:31.689554 [ 2871 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:32.223083 [ 3565 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:302: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf3a9cc 21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:32.696564 [ 2886 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:33.704720 [ 2908 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:34.719965 [ 2919 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:35.557699 [ 2756 ] {d0242175-0400-4091-9ba0-fbabe9be2a45} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=17, jobs=17). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:43670) (comment: 02343_group_by_use_nulls_distributed.sql) (in query: SELECT number, number % 2, sum(number) AS val FROM remote('127.0.0.{2,3}', numbers(10)) GROUP BY ROLLUP(number, number % 2) ORDER BY (number, number % 2, val) SETTINGS group_by_use_nulls=0;), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 11:00:35.651497 [ 2756 ] {d0242175-0400-4091-9ba0-fbabe9be2a45} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=17, jobs=17). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 11:00:35.842166 [ 5021 ] {a73e40b8-faab-4783-a942-3ff9de221afd} executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:55460). (NETWORK_ERROR) (version 24.3.12.76.altinitystable) (from [::ffff:127.0.0.1]:55460) (comment: 02343_group_by_use_nulls_distributed.sql) (in query: SELECT `__table1`.`number` AS `number`, `__table1`.`number` % 2 AS `modulo(number, 2)`, sum(`__table1`.`number`) AS `val` FROM numbers(10) AS `__table1` GROUP BY `__table1`.`number`, `__table1`.`number` % 2 WITH ROLLUP ORDER BY `__table1`.`number` ASC, `__table1`.`number` % 2 ASC, sum(`__table1`.`number`) ASC), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:169: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000134e8a44 7. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 8. /build/src/Server/TCPHandler.cpp:2301: DB::TCPHandler::sendProgress() @ 0x000000001d47b39d 9. /build/src/Server/TCPHandler.cpp:1088: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d47b21b 10. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d47005b 11. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 12. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 13. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 14. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 15. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 16. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 17. ? @ 0x00007f713a222ac3 18. ? @ 0x00007f713a2b4850 2024.12.16 11:00:35.854111 [ 2939 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:36.099968 [ 5021 ] {a73e40b8-faab-4783-a942-3ff9de221afd} TCPHandler: Can't send logs to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:55460). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:169: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000134e8a44 7. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 8. /build/src/Server/TCPHandler.cpp:2253: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x000000001d487055 9. /build/src/Server/TCPHandler.cpp:2330: DB::TCPHandler::sendLogs() @ 0x000000001d47bdff 10. /build/src/Server/TCPHandler.cpp:693: DB::TCPHandler::runImpl() @ 0x000000001d4712c2 11. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 12. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 13. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 14. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 15. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 16. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 17. ? @ 0x00007f713a222ac3 18. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:36.233425 [ 5021 ] {a73e40b8-faab-4783-a942-3ff9de221afd} TCPHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:55460). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:169: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000134e8a44 7. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 8. /build/src/Server/TCPHandler.cpp:2301: DB::TCPHandler::sendProgress() @ 0x000000001d47b39d 9. /build/src/Server/TCPHandler.cpp:1088: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d47b21b 10. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d47005b 11. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 12. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 13. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 14. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 15. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 16. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 17. ? @ 0x00007f713a222ac3 18. ? @ 0x00007f713a2b4850 2024.12.16 11:00:36.234585 [ 4402 ] {458ec47e-1450-45dd-8e7d-098535119cab} executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.3]:9000 -> [::ffff:127.0.0.1]:39282). (NETWORK_ERROR) (version 24.3.12.76.altinitystable) (from [::ffff:127.0.0.1]:39282) (comment: 02343_group_by_use_nulls_distributed.sql) (in query: SELECT `__table1`.`number` AS `number`, `__table1`.`number` % 2 AS `modulo(number, 2)`, sum(`__table1`.`number`) AS `val` FROM numbers(10) AS `__table1` GROUP BY `__table1`.`number`, `__table1`.`number` % 2 WITH ROLLUP ORDER BY `__table1`.`number` ASC, `__table1`.`number` % 2 ASC, sum(`__table1`.`number`) ASC), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:169: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000134e8a44 7. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 8. /build/src/Server/TCPHandler.cpp:2217: DB::TCPHandler::sendData(DB::Block const&) @ 0x000000001d47d38f 9. /build/src/Server/TCPHandler.cpp:1084: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d47b1aa 10. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d47005b 11. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 12. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 13. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 14. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 15. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 16. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 17. ? @ 0x00007f713a222ac3 18. ? @ 0x00007f713a2b4850 2024.12.16 11:00:36.236540 [ 5021 ] {a73e40b8-faab-4783-a942-3ff9de221afd} TCPHandler: Client has gone away. 2024.12.16 11:00:36.394961 [ 4402 ] {458ec47e-1450-45dd-8e7d-098535119cab} TCPHandler: Can't send logs to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.3]:9000 -> [::ffff:127.0.0.1]:39282). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:169: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000134e8a44 7. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 8. /build/src/Server/TCPHandler.cpp:2253: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x000000001d487055 9. /build/src/Server/TCPHandler.cpp:2330: DB::TCPHandler::sendLogs() @ 0x000000001d47bdff 10. /build/src/Server/TCPHandler.cpp:693: DB::TCPHandler::runImpl() @ 0x000000001d4712c2 11. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 12. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 13. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 14. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 15. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 16. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 17. ? @ 0x00007f713a222ac3 18. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:36.432169 [ 4402 ] {458ec47e-1450-45dd-8e7d-098535119cab} TCPHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.3]:9000 -> [::ffff:127.0.0.1]:39282). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:169: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000134e8a44 7. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 8. /build/src/Server/TCPHandler.cpp:2217: DB::TCPHandler::sendData(DB::Block const&) @ 0x000000001d47d38f 9. /build/src/Server/TCPHandler.cpp:1084: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d47b1aa 10. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d47005b 11. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 12. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 13. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 14. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 15. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 16. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 17. ? @ 0x00007f713a222ac3 18. ? @ 0x00007f713a2b4850 2024.12.16 11:00:36.452645 [ 4402 ] {458ec47e-1450-45dd-8e7d-098535119cab} TCPHandler: Client has gone away. 2024.12.16 11:00:36.874560 [ 2952 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:37.290781 [ 3544 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=3). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:298: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd2eaf 21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set, std::equal_to, std::allocator>&) @ 0x000000001ccd371a 22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf3803a 23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d (version 24.3.12.76.altinitystable) 2024.12.16 11:00:37.880936 [ 4402 ] {699d63f5-1403-4caa-a254-7691bfd4ad93} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=28, jobs=28). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:43702) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM system.processes WHERE query_id != queryID() AND current_database = currentDatabase() AND query LIKE '%-- 11317_tuple%'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 11:00:37.897352 [ 2973 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:38.021395 [ 4402 ] {699d63f5-1403-4caa-a254-7691bfd4ad93} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=28, jobs=28). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 11:00:38.640469 [ 3549 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::TextLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:323: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf3ae44 21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:38.899549 [ 2980 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:39.085991 [ 3491 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {bdb3abf1-bb86-44b8-a138-7f8c6b07475d::202412_1_51_10}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:302: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf3a9cc 21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37f43 23. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb722bf 24. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb725d8 25. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb71fb2 26. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13ef38 27. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x000000001cba15ed 28. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x000000001cba210e 29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef, StrongTypedef, std::basic_string_view>)::'lambda'()::operator()() const @ 0x000000001cba9c78 30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba9c55 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001cba9c35 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:39.903425 [ 2997 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:40.704189 [ 3484 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {fe54ed48-ddd9-4cf8-aa3b-418c81cf437c::202412_1_72_11}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=7). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:45: DB::MergeTreeDataPartWriterOnDisk::Stream::preFinalize() @ 0x000000001cce590d 21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:644: DB::MergeTreeDataPartWriterWide::fillDataChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set, std::equal_to, std::allocator>&) @ 0x000000001ccf2d83 22. /build/src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set, std::equal_to, std::allocator>&) @ 0x000000001ccf327e 23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf3803a 24. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37f43 25. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb722bf 26. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb725d8 27. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb71fb2 28. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13ef38 29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x000000001cba15ed 30. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x000000001cba210e 31. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef, StrongTypedef, std::basic_string_view>)::'lambda'()::operator()() const @ 0x000000001cba9c78 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:40.905921 [ 3013 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:40.945611 [ 2758 ] {66eaafb2-8b96-46c0-9015-4483f4bdbdf1} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=31, jobs=31). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:54222) (comment: 01083_window_view_select.sh) (in query: SELECT count(*) FROM wv), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 11:00:40.975618 [ 2758 ] {66eaafb2-8b96-46c0-9015-4483f4bdbdf1} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=31, jobs=31). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 11:00:41.914293 [ 3029 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:42.122587 [ 4401 ] {query_id_memory_bound_merging_1543232076} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=5, jobs=5). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:54234) (comment: 00177_memory_bound_merging.sh) (in query: SELECT URL, EventDate, max(URL) FROM remote(test_cluster_one_shard_two_replicas, test.hits) WHERE CounterID = 1704509 AND UserID = 4322253409885123546 GROUP BY CounterID, URL, EventDate ORDER BY URL, EventDate LIMIT 5 OFFSET 10 SETTINGS optimize_aggregation_in_order = 1, enable_memory_bound_merging_of_aggregation_results = 1, allow_experimental_parallel_reading_from_replicas = 1, parallel_replicas_for_non_replicated_merge_tree = 1, max_parallel_replicas = 3), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 11:00:42.374730 [ 4401 ] {query_id_memory_bound_merging_1543232076} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=5, jobs=5). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 11:00:42.392118 [ 3868 ] {} ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:52650). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x00000000134e6f2c 6. /build/src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x00000000134e60a0 7. /build/src/IO/ReadBuffer.h:70: DB::ReadBuffer::next() @ 0x000000000af5ec6a 8. /build/src/IO/ReadBuffer.h:106: void DB::varint_impl::readVarUInt(unsigned long&, DB::ReadBuffer&) @ 0x000000001335d78f 9. /build/src/IO/VarInt.h:111: DB::readVarUInt(unsigned long&, DB::ReadBuffer&) @ 0x000000001335d4ec 10. /build/src/IO/ReadHelpers.h:144: DB::readStringBinary(String&, DB::ReadBuffer&, unsigned long) @ 0x0000000013381fac 11. /build/src/Server/TCPHandler.cpp:0: DB::TCPHandler::receiveAddendum() @ 0x000000001d4793f4 12. /build/src/Server/TCPHandler.cpp:279: DB::TCPHandler::runImpl() @ 0x000000001d46cdf2 13. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 14. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 15. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 16. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 17. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 18. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 19. ? @ 0x00007f713a222ac3 20. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:42.935570 [ 3044 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:43.308825 [ 3868 ] {40897a63-0071-4c86-8954-eb75592ed001} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::ffff:127.0.0.1]:52246) (comment: 00177_memory_bound_merging.sh) (in query: SELECT `__table1`.`URL` AS `URL`, `__table1`.`EventDate` AS `EventDate`, `__table1`.`URL` AS `max(URL)` FROM `test`.`hits` AS `__table1` WHERE (`__table1`.`CounterID` = 1704509) AND (`__table1`.`UserID` = 4322253409885123546) GROUP BY `__table1`.`CounterID`, `__table1`.`URL`, `__table1`.`EventDate` ORDER BY `__table1`.`URL` ASC, `__table1`.`EventDate` ASC LIMIT _CAST(10, 'UInt64'), _CAST(5, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:748: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector, std::allocator>>&&, std::vector, std::allocator>>&&, std::shared_ptr, std::shared_ptr const&, DB::KeyCondition const&, std::optional const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, std::shared_ptr, unsigned long, std::vector>&, bool) @ 0x000000001cd10135 10. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1671: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector, std::allocator>>, std::vector, std::allocator>>, std::shared_ptr const&, DB::SelectQueryInfo const&, std::shared_ptr, unsigned long, std::shared_ptr, std::equal_to, std::allocator>>>, DB::MergeTreeData const&, std::vector> const&, std::shared_ptr, std::optional&) @ 0x000000001dd5ebc4 11. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1570: DB::ReadFromMergeTree::selectRangesToRead(std::vector, std::allocator>>, std::vector, std::allocator>>, std::shared_ptr const&, DB::SelectQueryInfo const&, std::shared_ptr, unsigned long, std::shared_ptr, std::equal_to, std::allocator>>>, DB::MergeTreeData const&, std::vector> const&, std::shared_ptr, std::optional&) @ 0x000000001dd5b86f 12. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1371: DB::ReadFromMergeTree::selectRangesToRead(std::vector, std::allocator>>, std::vector, std::allocator>>) const @ 0x000000001dd5b69e 13. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1854: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000001dd6148c 14. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1969: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd624fb 15. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector>, std::allocator>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd08c90 16. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3371f 17. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b508741 18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50849b 19. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 20. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 21. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 22. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 23. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 24. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 25. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 26. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 27. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 28. ? @ 0x00007f713a222ac3 29. ? @ 0x00007f713a2b4850 2024.12.16 11:00:43.340318 [ 3868 ] {40897a63-0071-4c86-8954-eb75592ed001} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:748: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector, std::allocator>>&&, std::vector, std::allocator>>&&, std::shared_ptr, std::shared_ptr const&, DB::KeyCondition const&, std::optional const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, std::shared_ptr, unsigned long, std::vector>&, bool) @ 0x000000001cd10135 10. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1671: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector, std::allocator>>, std::vector, std::allocator>>, std::shared_ptr const&, DB::SelectQueryInfo const&, std::shared_ptr, unsigned long, std::shared_ptr, std::equal_to, std::allocator>>>, DB::MergeTreeData const&, std::vector> const&, std::shared_ptr, std::optional&) @ 0x000000001dd5ebc4 11. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1570: DB::ReadFromMergeTree::selectRangesToRead(std::vector, std::allocator>>, std::vector, std::allocator>>, std::shared_ptr const&, DB::SelectQueryInfo const&, std::shared_ptr, unsigned long, std::shared_ptr, std::equal_to, std::allocator>>>, DB::MergeTreeData const&, std::vector> const&, std::shared_ptr, std::optional&) @ 0x000000001dd5b86f 12. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1371: DB::ReadFromMergeTree::selectRangesToRead(std::vector, std::allocator>>, std::vector, std::allocator>>) const @ 0x000000001dd5b69e 13. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1854: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000001dd6148c 14. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1969: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd624fb 15. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector>, std::allocator>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd08c90 16. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3371f 17. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b508741 18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50849b 19. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 20. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 21. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 22. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 23. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 24. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 25. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 26. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 27. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 28. ? @ 0x00007f713a222ac3 29. ? @ 0x00007f713a2b4850 2024.12.16 11:00:43.560977 [ 3485 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {bdb3abf1-bb86-44b8-a138-7f8c6b07475d::202412_1_51_10}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:294: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf3a8b6 21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37f43 23. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb722bf 24. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb725d8 25. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb71fb2 26. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13ef38 27. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x000000001cba15ed 28. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x000000001cba210e 29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef, StrongTypedef, std::basic_string_view>)::'lambda'()::operator()() const @ 0x000000001cba9c78 30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba9c55 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001cba9c35 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:43.561910 [ 2758 ] {8eee698f-c791-4c9c-b1fa-30e114392304} executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:52236). (NETWORK_ERROR) (version 24.3.12.76.altinitystable) (from [::ffff:127.0.0.1]:52236) (comment: 00177_memory_bound_merging.sh) (in query: SELECT `__table1`.`URL` AS `URL`, `__table1`.`EventDate` AS `EventDate`, `__table1`.`URL` AS `max(URL)` FROM `test`.`hits` AS `__table1` WHERE (`__table1`.`CounterID` = 1704509) AND (`__table1`.`UserID` = 4322253409885123546) GROUP BY `__table1`.`CounterID`, `__table1`.`URL`, `__table1`.`EventDate` ORDER BY `__table1`.`URL` ASC, `__table1`.`EventDate` ASC LIMIT _CAST(10, 'UInt64'), _CAST(5, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:169: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000134e8a44 7. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 8. /build/src/Server/TCPHandler.cpp:2216: DB::TCPHandler::sendData(DB::Block const&) @ 0x000000001d47d372 9. /build/src/Server/TCPHandler.cpp:1084: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d47b1aa 10. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d47005b 11. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 12. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 13. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 14. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 15. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 16. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 17. ? @ 0x00007f713a222ac3 18. ? @ 0x00007f713a2b4850 2024.12.16 11:00:43.746766 [ 4401 ] {} ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:52662). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x00000000134e6f2c 6. /build/src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x00000000134e60a0 7. /build/src/IO/ReadBuffer.h:70: DB::ReadBuffer::next() @ 0x000000000af5ec6a 8. /build/src/IO/ReadBuffer.h:106: DB::TCPHandler::runImpl() @ 0x000000001d46ea77 9. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 10. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 11. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 12. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 13. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 14. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 15. ? @ 0x00007f713a222ac3 16. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:43.755587 [ 3868 ] {} ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:52246). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x00000000134e6f2c 6. /build/src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x00000000134e60a0 7. /build/src/IO/ReadBuffer.h:70: DB::ReadBuffer::next() @ 0x000000000af5ec6a 8. /build/src/IO/ReadBuffer.h:106: DB::TCPHandler::runImpl() @ 0x000000001d46ea77 9. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 10. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 11. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 12. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 13. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 14. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 15. ? @ 0x00007f713a222ac3 16. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:43.791931 [ 2758 ] {8eee698f-c791-4c9c-b1fa-30e114392304} TCPHandler: Can't send logs to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:52236). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:169: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000134e8a44 7. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 8. /build/src/Server/TCPHandler.cpp:2253: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x000000001d487055 9. /build/src/Server/TCPHandler.cpp:2330: DB::TCPHandler::sendLogs() @ 0x000000001d47bdff 10. /build/src/Server/TCPHandler.cpp:693: DB::TCPHandler::runImpl() @ 0x000000001d4712c2 11. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 12. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 13. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 14. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 15. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 16. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 17. ? @ 0x00007f713a222ac3 18. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:43.799356 [ 2758 ] {8eee698f-c791-4c9c-b1fa-30e114392304} TCPHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:52236). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:169: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000134e8a44 7. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 8. /build/src/Server/TCPHandler.cpp:2216: DB::TCPHandler::sendData(DB::Block const&) @ 0x000000001d47d372 9. /build/src/Server/TCPHandler.cpp:1084: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d47b1aa 10. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d47005b 11. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 12. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 13. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 14. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 15. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 16. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 17. ? @ 0x00007f713a222ac3 18. ? @ 0x00007f713a2b4850 2024.12.16 11:00:43.871317 [ 2758 ] {8eee698f-c791-4c9c-b1fa-30e114392304} TCPHandler: Client has gone away. 2024.12.16 11:00:43.942025 [ 3068 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:44.949131 [ 2901 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:45.959108 [ 2929 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:46.962861 [ 3022 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:47.981454 [ 3107 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:48.047242 [ 3485 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {fe54ed48-ddd9-4cf8-aa3b-418c81cf437c::202412_1_72_11}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=5). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:43: DB::MergeTreeDataPartWriterOnDisk::Stream::preFinalize() @ 0x000000001cce58f4 21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:644: DB::MergeTreeDataPartWriterWide::fillDataChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set, std::equal_to, std::allocator>&) @ 0x000000001ccf2d83 22. /build/src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set, std::equal_to, std::allocator>&) @ 0x000000001ccf327e 23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf3803a 24. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37f43 25. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb722bf 26. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb725d8 27. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb71fb2 28. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13ef38 29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x000000001cba15ed 30. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x000000001cba210e 31. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef, StrongTypedef, std::basic_string_view>)::'lambda'()::operator()() const @ 0x000000001cba9c78 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:48.983735 [ 3111 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:49.402886 [ 3493 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {fe54ed48-ddd9-4cf8-aa3b-418c81cf437c::202412_1_73_11}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1fc91 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1fb3b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1faf0 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1fab0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1fa3b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce216d1 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1f750 16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future> DB::scheduleFromThreadPoolUnsafe, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl>&, String const&, Priority) @ 0x000000001ce1f09c 17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1d6c3 18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl>*, unsigned long) @ 0x000000001ce1d5b3 19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*, unsigned long, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&&, unsigned long&&) @ 0x000000001ce56a2c 20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*, unsigned long, void, void>(std::allocator&, DB::MergeTreeMarksLoader*, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&&, unsigned long&&) @ 0x000000001ce56935 21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*, unsigned long>(std::allocator, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&&, unsigned long&&) @ 0x000000001ce56863 22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], std::shared_ptr&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*, unsigned long, void>(std::allocator const&, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&&, unsigned long&&) @ 0x000000001ce56715 23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*, unsigned long, void>(std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&&, unsigned long&&) @ 0x000000001ce53cbb 24. /build/src/Storages/MergeTree/MergeTreeReaderCompact.cpp:37: DB::MergeTreeReaderCompact::MergeTreeReaderCompact(std::shared_ptr, DB::NamesAndTypesList, std::unordered_map, std::equal_to, std::allocator>> const&, std::shared_ptr const&, DB::UncompressedCache*, DB::MarkCache*, DB::MarkRanges, DB::MergeTreeReaderSettings, std::map, std::allocator>>, std::function const&, int) @ 0x000000001ce51f0a 25. /build/src/Storages/MergeTree/MergeTreeReaderCompactSingleBuffer.h:16: DB::MergeTreeReaderCompactSingleBuffer::MergeTreeReaderCompactSingleBuffer&, DB::NamesAndTypesList const&, std::unordered_map, std::equal_to, std::allocator>> const&, std::shared_ptr const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map, std::allocator>> const&, std::function const&, int>(std::shared_ptr&, DB::NamesAndTypesList const&, std::unordered_map, std::equal_to, std::allocator>> const&, std::shared_ptr const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map, std::allocator>> const&, std::function const&, int&&) @ 0x000000001ccc27a5 26. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, DB::NamesAndTypesList const&, std::unordered_map, std::equal_to, std::allocator>> const&, std::shared_ptr const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map, std::allocator>> const&, std::function const&, int>(std::shared_ptr&, DB::NamesAndTypesList const&, std::unordered_map, std::equal_to, std::allocator>> const&, std::shared_ptr const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map, std::allocator>> const&, std::function const&, int&&) @ 0x000000001ccc1b7d 27. /build/src/Storages/MergeTree/MergeTreeDataPartCompact.cpp:43: DB::MergeTreeDataPartCompact::getReader(DB::NamesAndTypesList const&, std::shared_ptr const&, DB::MarkRanges const&, std::unordered_map, std::equal_to, std::allocator>> const&, DB::UncompressedCache*, DB::MarkCache*, std::shared_ptr const&, DB::MergeTreeReaderSettings const&, std::map, std::allocator>> const&, std::function const&) const @ 0x000000001ccbeef3 28. /build/src/Storages/MergeTree/MergeTreeSequentialSource.cpp:177: DB::MergeTreeSequentialSource::MergeTreeSequentialSource(DB::MergeTreeSequentialSourceType, DB::MergeTreeData const&, std::shared_ptr const&, std::shared_ptr, std::vector>, std::optional, bool, bool, bool, bool) @ 0x000000001ce71ef0 29. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeSequentialSource* std::construct_at[abi:v15000] const&, std::shared_ptr&, std::vector>&, std::optional, bool, bool&, bool&, bool&, DB::MergeTreeSequentialSource*>(DB::MergeTreeSequentialSource*, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr const&, std::shared_ptr&, std::vector>&, std::optional&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce76047 30. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000] const&, std::shared_ptr&, std::vector>&, std::optional, bool, bool&, bool&, bool&, void, void>(std::allocator&, DB::MergeTreeSequentialSource*, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr const&, std::shared_ptr&, std::vector>&, std::optional&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce75d04 31. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000] const&, std::shared_ptr&, std::vector>&, std::optional, bool, bool&, bool&, bool&>(std::allocator, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr const&, std::shared_ptr&, std::vector>&, std::optional&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce759b1 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:49.990176 [ 3133 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:50.042056 [ 4402 ] {28b41948-a171-4833-98f0-be905e006aff} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=962, jobs=841). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:54208) (comment: 01780_column_sparse_filter.sql) (in query: SELECT count() FROM t_sparse WHERE notEmpty(s);), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133dc4ad 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d4458 8. /build/src/Common/ThreadPool.cpp:338: ThreadPoolImpl::scheduleOrThrow(std::function, Priority, unsigned long, bool) @ 0x00000000133d4d10 9. /build/src/Common/ThreadPool.h:205: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001d538cf3 10. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:112: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long) @ 0x000000001d538a34 11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:138: DB::PullingAsyncPipelineExecutor::pull(DB::Block&, unsigned long) @ 0x000000001d538de9 12. /build/src/Server/TCPHandler.cpp:1023: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d47ad7f 13. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d47005b 14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 20. ? @ 0x00007f713a222ac3 21. ? @ 0x00007f713a2b4850 2024.12.16 11:00:50.111890 [ 4402 ] {28b41948-a171-4833-98f0-be905e006aff} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=962, jobs=841). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133dc4ad 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d4458 8. /build/src/Common/ThreadPool.cpp:338: ThreadPoolImpl::scheduleOrThrow(std::function, Priority, unsigned long, bool) @ 0x00000000133d4d10 9. /build/src/Common/ThreadPool.h:205: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001d538cf3 10. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:112: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long) @ 0x000000001d538a34 11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:138: DB::PullingAsyncPipelineExecutor::pull(DB::Block&, unsigned long) @ 0x000000001d538de9 12. /build/src/Server/TCPHandler.cpp:1023: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d47ad7f 13. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d47005b 14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 20. ? @ 0x00007f713a222ac3 21. ? @ 0x00007f713a2b4850 2024.12.16 11:00:50.974185 [ 4402 ] {1f275212-e9a7-407c-a09b-2202fb295f1c} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=27, jobs=27). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:33190) (comment: 01083_window_view_select.sh) (in query: SELECT count(*) FROM wv), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 11:00:51.001316 [ 3151 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:51.061074 [ 4402 ] {1f275212-e9a7-407c-a09b-2202fb295f1c} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=27, jobs=27). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 11:00:52.011980 [ 3164 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:52.386172 [ 4402 ] {a9a9144e-e3d4-452e-86ff-cc3e5bca7d22} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=6, jobs=6). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:33194) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM system.processes WHERE query_id != queryID() AND current_database = currentDatabase() AND query LIKE '%-- 11317_tuple%'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 11:00:52.487478 [ 4402 ] {a9a9144e-e3d4-452e-86ff-cc3e5bca7d22} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=6, jobs=6). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 11:00:53.018973 [ 3180 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:54.039914 [ 3197 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:55.052137 [ 3209 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:55.855676 [ 4401 ] {7bf1cb7f-6480-4dc3-a56e-14df3d3c871c} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=19, jobs=19). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:33214) (comment: 01083_window_view_select.sh) (in query: SELECT count(*) FROM wv), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 11:00:55.885190 [ 4401 ] {7bf1cb7f-6480-4dc3-a56e-14df3d3c871c} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=19, jobs=19). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 11:00:55.913945 [ 4402 ] {1fda010a-31b8-4fd9-bfe5-f53526194bbd} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=21, jobs=21). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:33210) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM system.processes WHERE query_id != queryID() AND current_database = currentDatabase() AND query LIKE '%-- 11317_tuple%'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 11:00:56.028720 [ 4402 ] {1fda010a-31b8-4fd9-bfe5-f53526194bbd} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=21, jobs=21). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 11:00:56.065605 [ 3225 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:56.848168 [ 3868 ] {e53a523f-c561-4828-b5b5-8237d6d21c9c} executeQuery: Code: 43. DB::Exception: Second argument for function addSeconds must be a number: In scope SELECT now() + CAST('1', 'Int128'). (ILLEGAL_TYPE_OF_ARGUMENT) (version 24.3.12.76.altinitystable) (from [::1]:33230) (comment: 02469_interval_msan.sql) (in query: SELECT now() + 1::Int128;), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000a8efdf3 6. /build/src/Functions/FunctionDateOrDateTimeAddInterval.h:636: DB::FunctionDateOrDateTimeAddInterval::getReturnTypeImpl(std::vector> const&) const @ 0x000000000b927b6b 7. /build/src/Functions/IFunctionAdaptors.h:136: DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector> const&) const @ 0x000000000af69b50 8. /build/src/Functions/IFunction.cpp:522: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x00000000190653e7 9. /build/src/Functions/IFunction.cpp:468: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x0000000019064e36 10. /build/src/Functions/IFunction.cpp:483: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x0000000019065441 11. /build/src/Functions/FunctionBinaryArithmetic.h:1164: DB::FunctionBinaryArithmetic::executeDateTimeIntervalPlusMinus(std::vector> const&, std::shared_ptr const&, unsigned long, std::shared_ptr const&) const @ 0x000000001116301d 12. /build/src/Functions/FunctionBinaryArithmetic.h:2190: DB::FunctionBinaryArithmetic::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x00000000111614f4 13. /build/src/Functions/FunctionBinaryArithmetic.h:0: DB::FunctionBinaryArithmeticWithConstants::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001116060c 14. /build/src/Functions/IFunction.h:443: DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000a8ef299 15. /build/src/Functions/IFunctionAdaptors.h:26: DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000af6a9ad 16. /build/src/Functions/IFunction.cpp:277: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019062706 17. /build/src/Functions/IFunction.cpp:336: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019063826 18. /build/src/Functions/IFunction.cpp:411: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x00000000190648b5 19. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6185: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bdb89 20. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a24ea 21. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a0a21 22. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0ab1c7 23. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09cd43 24. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001b09af74 25. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr&, std::shared_ptr) @ 0x000000001b09ac33 26. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr) @ 0x000000001b08c3a6 27. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr const&, DB::SelectQueryOptions const&, std::shared_ptr const&, std::shared_ptr const&) @ 0x000000001b507dac 28. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x000000001b5069e6 29. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr const&, DB::SelectQueryOptions const&) @ 0x000000001b509db7 30. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50924c 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b5091fd 2024.12.16 11:00:56.850791 [ 3868 ] {e53a523f-c561-4828-b5b5-8237d6d21c9c} TCPHandler: Code: 43. DB::Exception: Second argument for function addSeconds must be a number: In scope SELECT now() + CAST('1', 'Int128'). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000a8efdf3 6. /build/src/Functions/FunctionDateOrDateTimeAddInterval.h:636: DB::FunctionDateOrDateTimeAddInterval::getReturnTypeImpl(std::vector> const&) const @ 0x000000000b927b6b 7. /build/src/Functions/IFunctionAdaptors.h:136: DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector> const&) const @ 0x000000000af69b50 8. /build/src/Functions/IFunction.cpp:522: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x00000000190653e7 9. /build/src/Functions/IFunction.cpp:468: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x0000000019064e36 10. /build/src/Functions/IFunction.cpp:483: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x0000000019065441 11. /build/src/Functions/FunctionBinaryArithmetic.h:1164: DB::FunctionBinaryArithmetic::executeDateTimeIntervalPlusMinus(std::vector> const&, std::shared_ptr const&, unsigned long, std::shared_ptr const&) const @ 0x000000001116301d 12. /build/src/Functions/FunctionBinaryArithmetic.h:2190: DB::FunctionBinaryArithmetic::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x00000000111614f4 13. /build/src/Functions/FunctionBinaryArithmetic.h:0: DB::FunctionBinaryArithmeticWithConstants::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001116060c 14. /build/src/Functions/IFunction.h:443: DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000a8ef299 15. /build/src/Functions/IFunctionAdaptors.h:26: DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000af6a9ad 16. /build/src/Functions/IFunction.cpp:277: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019062706 17. /build/src/Functions/IFunction.cpp:336: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019063826 18. /build/src/Functions/IFunction.cpp:411: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x00000000190648b5 19. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6185: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bdb89 20. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a24ea 21. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a0a21 22. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0ab1c7 23. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09cd43 24. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001b09af74 25. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr&, std::shared_ptr) @ 0x000000001b09ac33 26. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr) @ 0x000000001b08c3a6 27. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr const&, DB::SelectQueryOptions const&, std::shared_ptr const&, std::shared_ptr const&) @ 0x000000001b507dac 28. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x000000001b5069e6 29. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr const&, DB::SelectQueryOptions const&) @ 0x000000001b509db7 30. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50924c 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b5091fd 2024.12.16 11:00:57.039082 [ 3868 ] {48e38715-022d-4322-a78a-daf3e9cc7176} executeQuery: Code: 43. DB::Exception: Second argument for function addSeconds must be a number: In scope SELECT now() + CAST('1', 'Int256'). (ILLEGAL_TYPE_OF_ARGUMENT) (version 24.3.12.76.altinitystable) (from [::1]:33230) (comment: 02469_interval_msan.sql) (in query: SELECT now() + 1::Int256;), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000a8efdf3 6. /build/src/Functions/FunctionDateOrDateTimeAddInterval.h:636: DB::FunctionDateOrDateTimeAddInterval::getReturnTypeImpl(std::vector> const&) const @ 0x000000000b927b6b 7. /build/src/Functions/IFunctionAdaptors.h:136: DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector> const&) const @ 0x000000000af69b50 8. /build/src/Functions/IFunction.cpp:522: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x00000000190653e7 9. /build/src/Functions/IFunction.cpp:468: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x0000000019064e36 10. /build/src/Functions/IFunction.cpp:483: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x0000000019065441 11. /build/src/Functions/FunctionBinaryArithmetic.h:1164: DB::FunctionBinaryArithmetic::executeDateTimeIntervalPlusMinus(std::vector> const&, std::shared_ptr const&, unsigned long, std::shared_ptr const&) const @ 0x000000001116301d 12. /build/src/Functions/FunctionBinaryArithmetic.h:2190: DB::FunctionBinaryArithmetic::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x00000000111614f4 13. /build/src/Functions/FunctionBinaryArithmetic.h:0: DB::FunctionBinaryArithmeticWithConstants::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001116060c 14. /build/src/Functions/IFunction.h:443: DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000a8ef299 15. /build/src/Functions/IFunctionAdaptors.h:26: DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000af6a9ad 16. /build/src/Functions/IFunction.cpp:277: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019062706 17. /build/src/Functions/IFunction.cpp:336: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019063826 18. /build/src/Functions/IFunction.cpp:411: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x00000000190648b5 19. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6185: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bdb89 20. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a24ea 21. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a0a21 22. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0ab1c7 23. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09cd43 24. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001b09af74 25. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr&, std::shared_ptr) @ 0x000000001b09ac33 26. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr) @ 0x000000001b08c3a6 27. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr const&, DB::SelectQueryOptions const&, std::shared_ptr const&, std::shared_ptr const&) @ 0x000000001b507dac 28. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x000000001b5069e6 29. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr const&, DB::SelectQueryOptions const&) @ 0x000000001b509db7 30. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50924c 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b5091fd 2024.12.16 11:00:57.053471 [ 3868 ] {48e38715-022d-4322-a78a-daf3e9cc7176} TCPHandler: Code: 43. DB::Exception: Second argument for function addSeconds must be a number: In scope SELECT now() + CAST('1', 'Int256'). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000a8efdf3 6. /build/src/Functions/FunctionDateOrDateTimeAddInterval.h:636: DB::FunctionDateOrDateTimeAddInterval::getReturnTypeImpl(std::vector> const&) const @ 0x000000000b927b6b 7. /build/src/Functions/IFunctionAdaptors.h:136: DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector> const&) const @ 0x000000000af69b50 8. /build/src/Functions/IFunction.cpp:522: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x00000000190653e7 9. /build/src/Functions/IFunction.cpp:468: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x0000000019064e36 10. /build/src/Functions/IFunction.cpp:483: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x0000000019065441 11. /build/src/Functions/FunctionBinaryArithmetic.h:1164: DB::FunctionBinaryArithmetic::executeDateTimeIntervalPlusMinus(std::vector> const&, std::shared_ptr const&, unsigned long, std::shared_ptr const&) const @ 0x000000001116301d 12. /build/src/Functions/FunctionBinaryArithmetic.h:2190: DB::FunctionBinaryArithmetic::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x00000000111614f4 13. /build/src/Functions/FunctionBinaryArithmetic.h:0: DB::FunctionBinaryArithmeticWithConstants::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001116060c 14. /build/src/Functions/IFunction.h:443: DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000a8ef299 15. /build/src/Functions/IFunctionAdaptors.h:26: DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000af6a9ad 16. /build/src/Functions/IFunction.cpp:277: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019062706 17. /build/src/Functions/IFunction.cpp:336: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019063826 18. /build/src/Functions/IFunction.cpp:411: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x00000000190648b5 19. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6185: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bdb89 20. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a24ea 21. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a0a21 22. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0ab1c7 23. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09cd43 24. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001b09af74 25. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr&, std::shared_ptr) @ 0x000000001b09ac33 26. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr) @ 0x000000001b08c3a6 27. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr const&, DB::SelectQueryOptions const&, std::shared_ptr const&, std::shared_ptr const&) @ 0x000000001b507dac 28. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x000000001b5069e6 29. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr const&, DB::SelectQueryOptions const&) @ 0x000000001b509db7 30. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50924c 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b5091fd 2024.12.16 11:00:57.070346 [ 3236 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:57.273802 [ 3868 ] {cb3b545e-3f2b-488b-8dfb-b95ef66c5628} executeQuery: Code: 43. DB::Exception: Second argument for function addSeconds must be a number: In scope SELECT now() + CAST('1', 'UInt128'). (ILLEGAL_TYPE_OF_ARGUMENT) (version 24.3.12.76.altinitystable) (from [::1]:33230) (comment: 02469_interval_msan.sql) (in query: SELECT now() + 1::UInt128;), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000a8efdf3 6. /build/src/Functions/FunctionDateOrDateTimeAddInterval.h:636: DB::FunctionDateOrDateTimeAddInterval::getReturnTypeImpl(std::vector> const&) const @ 0x000000000b927b6b 7. /build/src/Functions/IFunctionAdaptors.h:136: DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector> const&) const @ 0x000000000af69b50 8. /build/src/Functions/IFunction.cpp:522: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x00000000190653e7 9. /build/src/Functions/IFunction.cpp:468: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x0000000019064e36 10. /build/src/Functions/IFunction.cpp:483: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x0000000019065441 11. /build/src/Functions/FunctionBinaryArithmetic.h:1164: DB::FunctionBinaryArithmetic::executeDateTimeIntervalPlusMinus(std::vector> const&, std::shared_ptr const&, unsigned long, std::shared_ptr const&) const @ 0x000000001116301d 12. /build/src/Functions/FunctionBinaryArithmetic.h:2190: DB::FunctionBinaryArithmetic::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x00000000111614f4 13. /build/src/Functions/FunctionBinaryArithmetic.h:0: DB::FunctionBinaryArithmeticWithConstants::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001116060c 14. /build/src/Functions/IFunction.h:443: DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000a8ef299 15. /build/src/Functions/IFunctionAdaptors.h:26: DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000af6a9ad 16. /build/src/Functions/IFunction.cpp:277: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019062706 17. /build/src/Functions/IFunction.cpp:336: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019063826 18. /build/src/Functions/IFunction.cpp:411: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x00000000190648b5 19. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6185: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bdb89 20. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a24ea 21. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a0a21 22. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0ab1c7 23. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09cd43 24. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001b09af74 25. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr&, std::shared_ptr) @ 0x000000001b09ac33 26. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr) @ 0x000000001b08c3a6 27. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr const&, DB::SelectQueryOptions const&, std::shared_ptr const&, std::shared_ptr const&) @ 0x000000001b507dac 28. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x000000001b5069e6 29. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr const&, DB::SelectQueryOptions const&) @ 0x000000001b509db7 30. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50924c 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b5091fd 2024.12.16 11:00:57.284455 [ 3868 ] {cb3b545e-3f2b-488b-8dfb-b95ef66c5628} TCPHandler: Code: 43. DB::Exception: Second argument for function addSeconds must be a number: In scope SELECT now() + CAST('1', 'UInt128'). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000a8efdf3 6. /build/src/Functions/FunctionDateOrDateTimeAddInterval.h:636: DB::FunctionDateOrDateTimeAddInterval::getReturnTypeImpl(std::vector> const&) const @ 0x000000000b927b6b 7. /build/src/Functions/IFunctionAdaptors.h:136: DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector> const&) const @ 0x000000000af69b50 8. /build/src/Functions/IFunction.cpp:522: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x00000000190653e7 9. /build/src/Functions/IFunction.cpp:468: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x0000000019064e36 10. /build/src/Functions/IFunction.cpp:483: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x0000000019065441 11. /build/src/Functions/FunctionBinaryArithmetic.h:1164: DB::FunctionBinaryArithmetic::executeDateTimeIntervalPlusMinus(std::vector> const&, std::shared_ptr const&, unsigned long, std::shared_ptr const&) const @ 0x000000001116301d 12. /build/src/Functions/FunctionBinaryArithmetic.h:2190: DB::FunctionBinaryArithmetic::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x00000000111614f4 13. /build/src/Functions/FunctionBinaryArithmetic.h:0: DB::FunctionBinaryArithmeticWithConstants::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001116060c 14. /build/src/Functions/IFunction.h:443: DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000a8ef299 15. /build/src/Functions/IFunctionAdaptors.h:26: DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000af6a9ad 16. /build/src/Functions/IFunction.cpp:277: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019062706 17. /build/src/Functions/IFunction.cpp:336: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019063826 18. /build/src/Functions/IFunction.cpp:411: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x00000000190648b5 19. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6185: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bdb89 20. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a24ea 21. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a0a21 22. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0ab1c7 23. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09cd43 24. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001b09af74 25. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr&, std::shared_ptr) @ 0x000000001b09ac33 26. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr) @ 0x000000001b08c3a6 27. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr const&, DB::SelectQueryOptions const&, std::shared_ptr const&, std::shared_ptr const&) @ 0x000000001b507dac 28. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x000000001b5069e6 29. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr const&, DB::SelectQueryOptions const&) @ 0x000000001b509db7 30. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50924c 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b5091fd 2024.12.16 11:00:57.504936 [ 3868 ] {ce823a2a-2772-4247-8409-d763d3f89375} executeQuery: Code: 43. DB::Exception: Second argument for function addSeconds must be a number: In scope SELECT now() + CAST('1', 'UInt256'). (ILLEGAL_TYPE_OF_ARGUMENT) (version 24.3.12.76.altinitystable) (from [::1]:33230) (comment: 02469_interval_msan.sql) (in query: SELECT now() + 1::UInt256;), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000a8efdf3 6. /build/src/Functions/FunctionDateOrDateTimeAddInterval.h:636: DB::FunctionDateOrDateTimeAddInterval::getReturnTypeImpl(std::vector> const&) const @ 0x000000000b927b6b 7. /build/src/Functions/IFunctionAdaptors.h:136: DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector> const&) const @ 0x000000000af69b50 8. /build/src/Functions/IFunction.cpp:522: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x00000000190653e7 9. /build/src/Functions/IFunction.cpp:468: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x0000000019064e36 10. /build/src/Functions/IFunction.cpp:483: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x0000000019065441 11. /build/src/Functions/FunctionBinaryArithmetic.h:1164: DB::FunctionBinaryArithmetic::executeDateTimeIntervalPlusMinus(std::vector> const&, std::shared_ptr const&, unsigned long, std::shared_ptr const&) const @ 0x000000001116301d 12. /build/src/Functions/FunctionBinaryArithmetic.h:2190: DB::FunctionBinaryArithmetic::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x00000000111614f4 13. /build/src/Functions/FunctionBinaryArithmetic.h:0: DB::FunctionBinaryArithmeticWithConstants::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001116060c 14. /build/src/Functions/IFunction.h:443: DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000a8ef299 15. /build/src/Functions/IFunctionAdaptors.h:26: DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000af6a9ad 16. /build/src/Functions/IFunction.cpp:277: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019062706 17. /build/src/Functions/IFunction.cpp:336: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019063826 18. /build/src/Functions/IFunction.cpp:411: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x00000000190648b5 19. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6185: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bdb89 20. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a24ea 21. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a0a21 22. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0ab1c7 23. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09cd43 24. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001b09af74 25. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr&, std::shared_ptr) @ 0x000000001b09ac33 26. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr) @ 0x000000001b08c3a6 27. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr const&, DB::SelectQueryOptions const&, std::shared_ptr const&, std::shared_ptr const&) @ 0x000000001b507dac 28. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x000000001b5069e6 29. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr const&, DB::SelectQueryOptions const&) @ 0x000000001b509db7 30. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50924c 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b5091fd 2024.12.16 11:00:57.525261 [ 3868 ] {ce823a2a-2772-4247-8409-d763d3f89375} TCPHandler: Code: 43. DB::Exception: Second argument for function addSeconds must be a number: In scope SELECT now() + CAST('1', 'UInt256'). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000a8efdf3 6. /build/src/Functions/FunctionDateOrDateTimeAddInterval.h:636: DB::FunctionDateOrDateTimeAddInterval::getReturnTypeImpl(std::vector> const&) const @ 0x000000000b927b6b 7. /build/src/Functions/IFunctionAdaptors.h:136: DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector> const&) const @ 0x000000000af69b50 8. /build/src/Functions/IFunction.cpp:522: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x00000000190653e7 9. /build/src/Functions/IFunction.cpp:468: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x0000000019064e36 10. /build/src/Functions/IFunction.cpp:483: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x0000000019065441 11. /build/src/Functions/FunctionBinaryArithmetic.h:1164: DB::FunctionBinaryArithmetic::executeDateTimeIntervalPlusMinus(std::vector> const&, std::shared_ptr const&, unsigned long, std::shared_ptr const&) const @ 0x000000001116301d 12. /build/src/Functions/FunctionBinaryArithmetic.h:2190: DB::FunctionBinaryArithmetic::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x00000000111614f4 13. /build/src/Functions/FunctionBinaryArithmetic.h:0: DB::FunctionBinaryArithmeticWithConstants::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000001116060c 14. /build/src/Functions/IFunction.h:443: DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000a8ef299 15. /build/src/Functions/IFunctionAdaptors.h:26: DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000af6a9ad 16. /build/src/Functions/IFunction.cpp:277: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019062706 17. /build/src/Functions/IFunction.cpp:336: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019063826 18. /build/src/Functions/IFunction.cpp:411: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x00000000190648b5 19. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6185: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bdb89 20. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a24ea 21. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a0a21 22. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0ab1c7 23. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09cd43 24. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001b09af74 25. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr&, std::shared_ptr) @ 0x000000001b09ac33 26. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr) @ 0x000000001b08c3a6 27. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr const&, DB::SelectQueryOptions const&, std::shared_ptr const&, std::shared_ptr const&) @ 0x000000001b507dac 28. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x000000001b5069e6 29. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr const&, DB::SelectQueryOptions const&) @ 0x000000001b509db7 30. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50924c 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b5091fd 2024.12.16 11:00:58.031208 [ 3868 ] {2e212bb6-45cf-4d11-9fe1-01615bb29e68} executeQuery: Code: 43. DB::Exception: Second argument for function subtractSeconds must be a number: In scope SELECT now() - CAST('1', 'Int128'). (ILLEGAL_TYPE_OF_ARGUMENT) (version 24.3.12.76.altinitystable) (from [::1]:33230) (comment: 02469_interval_msan.sql) (in query: SELECT now() - 1::Int128;), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000a8efdf3 6. /build/src/Functions/FunctionDateOrDateTimeAddInterval.h:636: DB::FunctionDateOrDateTimeAddInterval::getReturnTypeImpl(std::vector> const&) const @ 0x0000000011d65dab 7. /build/src/Functions/IFunctionAdaptors.h:136: DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector> const&) const @ 0x000000000af69b50 8. /build/src/Functions/IFunction.cpp:522: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x00000000190653e7 9. /build/src/Functions/IFunction.cpp:468: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x0000000019064e36 10. /build/src/Functions/IFunction.cpp:483: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x0000000019065441 11. /build/src/Functions/FunctionBinaryArithmetic.h:1164: DB::FunctionBinaryArithmetic::executeDateTimeIntervalPlusMinus(std::vector> const&, std::shared_ptr const&, unsigned long, std::shared_ptr const&) const @ 0x000000000fc477dd 12. /build/src/Functions/FunctionBinaryArithmetic.h:2190: DB::FunctionBinaryArithmetic::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000fc45d14 13. /build/src/Functions/FunctionBinaryArithmetic.h:0: DB::FunctionBinaryArithmeticWithConstants::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000fc44e2c 14. /build/src/Functions/IFunction.h:443: DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000a8ef299 15. /build/src/Functions/IFunctionAdaptors.h:26: DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000af6a9ad 16. /build/src/Functions/IFunction.cpp:277: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019062706 17. /build/src/Functions/IFunction.cpp:336: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019063826 18. /build/src/Functions/IFunction.cpp:411: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x00000000190648b5 19. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6185: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bdb89 20. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a24ea 21. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a0a21 22. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0ab1c7 23. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09cd43 24. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001b09af74 25. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr&, std::shared_ptr) @ 0x000000001b09ac33 26. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr) @ 0x000000001b08c3a6 27. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr const&, DB::SelectQueryOptions const&, std::shared_ptr const&, std::shared_ptr const&) @ 0x000000001b507dac 28. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x000000001b5069e6 29. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr const&, DB::SelectQueryOptions const&) @ 0x000000001b509db7 30. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50924c 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b5091fd 2024.12.16 11:00:58.038419 [ 3868 ] {2e212bb6-45cf-4d11-9fe1-01615bb29e68} TCPHandler: Code: 43. DB::Exception: Second argument for function subtractSeconds must be a number: In scope SELECT now() - CAST('1', 'Int128'). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000a8efdf3 6. /build/src/Functions/FunctionDateOrDateTimeAddInterval.h:636: DB::FunctionDateOrDateTimeAddInterval::getReturnTypeImpl(std::vector> const&) const @ 0x0000000011d65dab 7. /build/src/Functions/IFunctionAdaptors.h:136: DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector> const&) const @ 0x000000000af69b50 8. /build/src/Functions/IFunction.cpp:522: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x00000000190653e7 9. /build/src/Functions/IFunction.cpp:468: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x0000000019064e36 10. /build/src/Functions/IFunction.cpp:483: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x0000000019065441 11. /build/src/Functions/FunctionBinaryArithmetic.h:1164: DB::FunctionBinaryArithmetic::executeDateTimeIntervalPlusMinus(std::vector> const&, std::shared_ptr const&, unsigned long, std::shared_ptr const&) const @ 0x000000000fc477dd 12. /build/src/Functions/FunctionBinaryArithmetic.h:2190: DB::FunctionBinaryArithmetic::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000fc45d14 13. /build/src/Functions/FunctionBinaryArithmetic.h:0: DB::FunctionBinaryArithmeticWithConstants::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000fc44e2c 14. /build/src/Functions/IFunction.h:443: DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000a8ef299 15. /build/src/Functions/IFunctionAdaptors.h:26: DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000af6a9ad 16. /build/src/Functions/IFunction.cpp:277: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019062706 17. /build/src/Functions/IFunction.cpp:336: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019063826 18. /build/src/Functions/IFunction.cpp:411: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x00000000190648b5 19. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6185: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bdb89 20. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a24ea 21. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a0a21 22. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0ab1c7 23. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09cd43 24. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001b09af74 25. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr&, std::shared_ptr) @ 0x000000001b09ac33 26. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr) @ 0x000000001b08c3a6 27. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr const&, DB::SelectQueryOptions const&, std::shared_ptr const&, std::shared_ptr const&) @ 0x000000001b507dac 28. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x000000001b5069e6 29. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr const&, DB::SelectQueryOptions const&) @ 0x000000001b509db7 30. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50924c 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b5091fd 2024.12.16 11:00:58.084855 [ 3254 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:58.225766 [ 3868 ] {7251490c-74f4-4c45-811f-3fee178f9d52} executeQuery: Code: 43. DB::Exception: Second argument for function subtractSeconds must be a number: In scope SELECT now() - CAST('1', 'Int256'). (ILLEGAL_TYPE_OF_ARGUMENT) (version 24.3.12.76.altinitystable) (from [::1]:33230) (comment: 02469_interval_msan.sql) (in query: SELECT now() - 1::Int256;), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000a8efdf3 6. /build/src/Functions/FunctionDateOrDateTimeAddInterval.h:636: DB::FunctionDateOrDateTimeAddInterval::getReturnTypeImpl(std::vector> const&) const @ 0x0000000011d65dab 7. /build/src/Functions/IFunctionAdaptors.h:136: DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector> const&) const @ 0x000000000af69b50 8. /build/src/Functions/IFunction.cpp:522: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x00000000190653e7 9. /build/src/Functions/IFunction.cpp:468: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x0000000019064e36 10. /build/src/Functions/IFunction.cpp:483: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x0000000019065441 11. /build/src/Functions/FunctionBinaryArithmetic.h:1164: DB::FunctionBinaryArithmetic::executeDateTimeIntervalPlusMinus(std::vector> const&, std::shared_ptr const&, unsigned long, std::shared_ptr const&) const @ 0x000000000fc477dd 12. /build/src/Functions/FunctionBinaryArithmetic.h:2190: DB::FunctionBinaryArithmetic::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000fc45d14 13. /build/src/Functions/FunctionBinaryArithmetic.h:0: DB::FunctionBinaryArithmeticWithConstants::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000fc44e2c 14. /build/src/Functions/IFunction.h:443: DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000a8ef299 15. /build/src/Functions/IFunctionAdaptors.h:26: DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000af6a9ad 16. /build/src/Functions/IFunction.cpp:277: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019062706 17. /build/src/Functions/IFunction.cpp:336: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019063826 18. /build/src/Functions/IFunction.cpp:411: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x00000000190648b5 19. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6185: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bdb89 20. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a24ea 21. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a0a21 22. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0ab1c7 23. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09cd43 24. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001b09af74 25. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr&, std::shared_ptr) @ 0x000000001b09ac33 26. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr) @ 0x000000001b08c3a6 27. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr const&, DB::SelectQueryOptions const&, std::shared_ptr const&, std::shared_ptr const&) @ 0x000000001b507dac 28. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x000000001b5069e6 29. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr const&, DB::SelectQueryOptions const&) @ 0x000000001b509db7 30. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50924c 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b5091fd 2024.12.16 11:00:58.227863 [ 3868 ] {7251490c-74f4-4c45-811f-3fee178f9d52} TCPHandler: Code: 43. DB::Exception: Second argument for function subtractSeconds must be a number: In scope SELECT now() - CAST('1', 'Int256'). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000a8efdf3 6. /build/src/Functions/FunctionDateOrDateTimeAddInterval.h:636: DB::FunctionDateOrDateTimeAddInterval::getReturnTypeImpl(std::vector> const&) const @ 0x0000000011d65dab 7. /build/src/Functions/IFunctionAdaptors.h:136: DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector> const&) const @ 0x000000000af69b50 8. /build/src/Functions/IFunction.cpp:522: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x00000000190653e7 9. /build/src/Functions/IFunction.cpp:468: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x0000000019064e36 10. /build/src/Functions/IFunction.cpp:483: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x0000000019065441 11. /build/src/Functions/FunctionBinaryArithmetic.h:1164: DB::FunctionBinaryArithmetic::executeDateTimeIntervalPlusMinus(std::vector> const&, std::shared_ptr const&, unsigned long, std::shared_ptr const&) const @ 0x000000000fc477dd 12. /build/src/Functions/FunctionBinaryArithmetic.h:2190: DB::FunctionBinaryArithmetic::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000fc45d14 13. /build/src/Functions/FunctionBinaryArithmetic.h:0: DB::FunctionBinaryArithmeticWithConstants::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000fc44e2c 14. /build/src/Functions/IFunction.h:443: DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000a8ef299 15. /build/src/Functions/IFunctionAdaptors.h:26: DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000af6a9ad 16. /build/src/Functions/IFunction.cpp:277: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019062706 17. /build/src/Functions/IFunction.cpp:336: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019063826 18. /build/src/Functions/IFunction.cpp:411: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x00000000190648b5 19. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6185: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bdb89 20. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a24ea 21. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a0a21 22. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0ab1c7 23. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09cd43 24. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001b09af74 25. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr&, std::shared_ptr) @ 0x000000001b09ac33 26. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr) @ 0x000000001b08c3a6 27. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr const&, DB::SelectQueryOptions const&, std::shared_ptr const&, std::shared_ptr const&) @ 0x000000001b507dac 28. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x000000001b5069e6 29. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr const&, DB::SelectQueryOptions const&) @ 0x000000001b509db7 30. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50924c 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b5091fd 2024.12.16 11:00:58.429376 [ 3868 ] {ded29755-c890-4110-8228-50c3dbd64c29} executeQuery: Code: 43. DB::Exception: Second argument for function subtractSeconds must be a number: In scope SELECT now() - CAST('1', 'UInt128'). (ILLEGAL_TYPE_OF_ARGUMENT) (version 24.3.12.76.altinitystable) (from [::1]:33230) (comment: 02469_interval_msan.sql) (in query: SELECT now() - 1::UInt128;), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000a8efdf3 6. /build/src/Functions/FunctionDateOrDateTimeAddInterval.h:636: DB::FunctionDateOrDateTimeAddInterval::getReturnTypeImpl(std::vector> const&) const @ 0x0000000011d65dab 7. /build/src/Functions/IFunctionAdaptors.h:136: DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector> const&) const @ 0x000000000af69b50 8. /build/src/Functions/IFunction.cpp:522: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x00000000190653e7 9. /build/src/Functions/IFunction.cpp:468: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x0000000019064e36 10. /build/src/Functions/IFunction.cpp:483: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x0000000019065441 11. /build/src/Functions/FunctionBinaryArithmetic.h:1164: DB::FunctionBinaryArithmetic::executeDateTimeIntervalPlusMinus(std::vector> const&, std::shared_ptr const&, unsigned long, std::shared_ptr const&) const @ 0x000000000fc477dd 12. /build/src/Functions/FunctionBinaryArithmetic.h:2190: DB::FunctionBinaryArithmetic::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000fc45d14 13. /build/src/Functions/FunctionBinaryArithmetic.h:0: DB::FunctionBinaryArithmeticWithConstants::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000fc44e2c 14. /build/src/Functions/IFunction.h:443: DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000a8ef299 15. /build/src/Functions/IFunctionAdaptors.h:26: DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000af6a9ad 16. /build/src/Functions/IFunction.cpp:277: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019062706 17. /build/src/Functions/IFunction.cpp:336: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019063826 18. /build/src/Functions/IFunction.cpp:411: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x00000000190648b5 19. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6185: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bdb89 20. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a24ea 21. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a0a21 22. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0ab1c7 23. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09cd43 24. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001b09af74 25. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr&, std::shared_ptr) @ 0x000000001b09ac33 26. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr) @ 0x000000001b08c3a6 27. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr const&, DB::SelectQueryOptions const&, std::shared_ptr const&, std::shared_ptr const&) @ 0x000000001b507dac 28. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x000000001b5069e6 29. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr const&, DB::SelectQueryOptions const&) @ 0x000000001b509db7 30. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50924c 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b5091fd 2024.12.16 11:00:58.435114 [ 3868 ] {ded29755-c890-4110-8228-50c3dbd64c29} TCPHandler: Code: 43. DB::Exception: Second argument for function subtractSeconds must be a number: In scope SELECT now() - CAST('1', 'UInt128'). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000a8efdf3 6. /build/src/Functions/FunctionDateOrDateTimeAddInterval.h:636: DB::FunctionDateOrDateTimeAddInterval::getReturnTypeImpl(std::vector> const&) const @ 0x0000000011d65dab 7. /build/src/Functions/IFunctionAdaptors.h:136: DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector> const&) const @ 0x000000000af69b50 8. /build/src/Functions/IFunction.cpp:522: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x00000000190653e7 9. /build/src/Functions/IFunction.cpp:468: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x0000000019064e36 10. /build/src/Functions/IFunction.cpp:483: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x0000000019065441 11. /build/src/Functions/FunctionBinaryArithmetic.h:1164: DB::FunctionBinaryArithmetic::executeDateTimeIntervalPlusMinus(std::vector> const&, std::shared_ptr const&, unsigned long, std::shared_ptr const&) const @ 0x000000000fc477dd 12. /build/src/Functions/FunctionBinaryArithmetic.h:2190: DB::FunctionBinaryArithmetic::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000fc45d14 13. /build/src/Functions/FunctionBinaryArithmetic.h:0: DB::FunctionBinaryArithmeticWithConstants::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000fc44e2c 14. /build/src/Functions/IFunction.h:443: DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000a8ef299 15. /build/src/Functions/IFunctionAdaptors.h:26: DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000af6a9ad 16. /build/src/Functions/IFunction.cpp:277: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019062706 17. /build/src/Functions/IFunction.cpp:336: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019063826 18. /build/src/Functions/IFunction.cpp:411: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x00000000190648b5 19. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6185: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bdb89 20. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a24ea 21. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a0a21 22. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0ab1c7 23. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09cd43 24. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001b09af74 25. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr&, std::shared_ptr) @ 0x000000001b09ac33 26. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr) @ 0x000000001b08c3a6 27. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr const&, DB::SelectQueryOptions const&, std::shared_ptr const&, std::shared_ptr const&) @ 0x000000001b507dac 28. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x000000001b5069e6 29. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr const&, DB::SelectQueryOptions const&) @ 0x000000001b509db7 30. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50924c 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b5091fd 2024.12.16 11:00:58.618911 [ 3868 ] {dbd0bc4a-5053-470c-8bfe-90c025d50c31} executeQuery: Code: 43. DB::Exception: Second argument for function subtractSeconds must be a number: In scope SELECT now() - CAST('1', 'UInt256'). (ILLEGAL_TYPE_OF_ARGUMENT) (version 24.3.12.76.altinitystable) (from [::1]:33230) (comment: 02469_interval_msan.sql) (in query: SELECT now() - 1::UInt256;), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000a8efdf3 6. /build/src/Functions/FunctionDateOrDateTimeAddInterval.h:636: DB::FunctionDateOrDateTimeAddInterval::getReturnTypeImpl(std::vector> const&) const @ 0x0000000011d65dab 7. /build/src/Functions/IFunctionAdaptors.h:136: DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector> const&) const @ 0x000000000af69b50 8. /build/src/Functions/IFunction.cpp:522: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x00000000190653e7 9. /build/src/Functions/IFunction.cpp:468: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x0000000019064e36 10. /build/src/Functions/IFunction.cpp:483: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x0000000019065441 11. /build/src/Functions/FunctionBinaryArithmetic.h:1164: DB::FunctionBinaryArithmetic::executeDateTimeIntervalPlusMinus(std::vector> const&, std::shared_ptr const&, unsigned long, std::shared_ptr const&) const @ 0x000000000fc477dd 12. /build/src/Functions/FunctionBinaryArithmetic.h:2190: DB::FunctionBinaryArithmetic::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000fc45d14 13. /build/src/Functions/FunctionBinaryArithmetic.h:0: DB::FunctionBinaryArithmeticWithConstants::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000fc44e2c 14. /build/src/Functions/IFunction.h:443: DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000a8ef299 15. /build/src/Functions/IFunctionAdaptors.h:26: DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000af6a9ad 16. /build/src/Functions/IFunction.cpp:277: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019062706 17. /build/src/Functions/IFunction.cpp:336: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019063826 18. /build/src/Functions/IFunction.cpp:411: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x00000000190648b5 19. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6185: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bdb89 20. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a24ea 21. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a0a21 22. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0ab1c7 23. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09cd43 24. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001b09af74 25. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr&, std::shared_ptr) @ 0x000000001b09ac33 26. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr) @ 0x000000001b08c3a6 27. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr const&, DB::SelectQueryOptions const&, std::shared_ptr const&, std::shared_ptr const&) @ 0x000000001b507dac 28. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x000000001b5069e6 29. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr const&, DB::SelectQueryOptions const&) @ 0x000000001b509db7 30. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50924c 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b5091fd 2024.12.16 11:00:58.629570 [ 3868 ] {dbd0bc4a-5053-470c-8bfe-90c025d50c31} TCPHandler: Code: 43. DB::Exception: Second argument for function subtractSeconds must be a number: In scope SELECT now() - CAST('1', 'UInt256'). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000a8efdf3 6. /build/src/Functions/FunctionDateOrDateTimeAddInterval.h:636: DB::FunctionDateOrDateTimeAddInterval::getReturnTypeImpl(std::vector> const&) const @ 0x0000000011d65dab 7. /build/src/Functions/IFunctionAdaptors.h:136: DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector> const&) const @ 0x000000000af69b50 8. /build/src/Functions/IFunction.cpp:522: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector> const&) const @ 0x00000000190653e7 9. /build/src/Functions/IFunction.cpp:468: DB::IFunctionOverloadResolver::getReturnType(std::vector> const&) const @ 0x0000000019064e36 10. /build/src/Functions/IFunction.cpp:483: DB::IFunctionOverloadResolver::build(std::vector> const&) const @ 0x0000000019065441 11. /build/src/Functions/FunctionBinaryArithmetic.h:1164: DB::FunctionBinaryArithmetic::executeDateTimeIntervalPlusMinus(std::vector> const&, std::shared_ptr const&, unsigned long, std::shared_ptr const&) const @ 0x000000000fc477dd 12. /build/src/Functions/FunctionBinaryArithmetic.h:2190: DB::FunctionBinaryArithmetic::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000fc45d14 13. /build/src/Functions/FunctionBinaryArithmetic.h:0: DB::FunctionBinaryArithmeticWithConstants::executeImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000fc44e2c 14. /build/src/Functions/IFunction.h:443: DB::IFunction::executeImplDryRun(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000a8ef299 15. /build/src/Functions/IFunctionAdaptors.h:26: DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector> const&, std::shared_ptr const&, unsigned long) const @ 0x000000000af6a9ad 16. /build/src/Functions/IFunction.cpp:277: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019062706 17. /build/src/Functions/IFunction.cpp:336: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x0000000019063826 18. /build/src/Functions/IFunction.cpp:411: DB::IExecutableFunction::execute(std::vector> const&, std::shared_ptr const&, unsigned long, bool) const @ 0x00000000190648b5 19. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6185: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bdb89 20. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a24ea 21. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a0a21 22. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0ab1c7 23. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09cd43 24. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001b09af74 25. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr&, std::shared_ptr) @ 0x000000001b09ac33 26. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr) @ 0x000000001b08c3a6 27. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr const&, DB::SelectQueryOptions const&, std::shared_ptr const&, std::shared_ptr const&) @ 0x000000001b507dac 28. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x000000001b5069e6 29. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr const&, DB::SelectQueryOptions const&) @ 0x000000001b509db7 30. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50924c 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b5091fd 2024.12.16 11:00:59.091396 [ 3255 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:00:59.355858 [ 4401 ] {37fa127d-40df-4a1a-b175-11934c6b381b} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=4, jobs=4). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:48028) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM system.processes WHERE query_id != queryID() AND current_database = currentDatabase() AND query LIKE '%-- 11317_tuple%'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 11:00:59.404918 [ 4401 ] {37fa127d-40df-4a1a-b175-11934c6b381b} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=4, jobs=4). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 11:01:00.094254 [ 3281 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:01:01.102571 [ 3290 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:01:02.109643 [ 3298 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:01:03.111600 [ 3314 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:01:04.117574 [ 3322 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:01:04.599498 [ 4402 ] {2007eae7-0365-4db3-91c2-b957dc763461} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=6, jobs=6). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:48050) (comment: 00023_totals_limit.sql) (in query: SELECT goals_alias.ID AS `ym:s:goalDimension`, uniqIf(UserID, (UserID != 0) AND (`_uniq_Goals` = 1)) FROM test.visits ARRAY JOIN Goals AS goals_alias, arrayEnumerateUniq(Goals.ID) AS `_uniq_Goals` WHERE (CounterID = 842440) GROUP BY `ym:s:goalDimension` WITH TOTALS ORDER BY `ym:s:goalDimension` LIMIT 0, 1 FORMAT JSONCompact;), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 11:01:04.967368 [ 4402 ] {2007eae7-0365-4db3-91c2-b957dc763461} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=6, jobs=6). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 11:01:05.132006 [ 3339 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:01:05.428884 [ 3479 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {41d82839-5472-4425-b891-a2dc2a236577::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:45: DB::MergeTreeDataPartWriterOnDisk::Stream::preFinalize() @ 0x000000001cce590d 22. /build/src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:644: DB::MergeTreeDataPartWriterWide::fillDataChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set, std::equal_to, std::allocator>&) @ 0x000000001ccf2d83 23. /build/src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set, std::equal_to, std::allocator>&) @ 0x000000001ccf327e 24. /build/src/Storages/MergeTree/MergedColumnOnlyOutputStream.cpp:69: DB::MergedColumnOnlyOutputStream::fillChecksums(std::shared_ptr&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf3f61a 25. /build/src/Storages/MergeTree/MergeTask.cpp:657: DB::MergeTask::VerticalMergeStage::finalizeVerticalMergeForOneColumn() const @ 0x000000001cb6f2bd 26. /build/src/Storages/MergeTree/MergeTask.cpp:877: DB::MergeTask::VerticalMergeStage::executeVerticalMergeForAllColumns() const @ 0x000000001cb7276e 27. /build/src/Storages/MergeTree/MergeTask.cpp:829: DB::MergeTask::VerticalMergeStage::execute() @ 0x000000001cb724b8 28. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb71fb2 29. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13ef38 30. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x000000001cba15ed 31. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x000000001cba210e (version 24.3.12.76.altinitystable) 2024.12.16 11:01:05.796152 [ 4401 ] {213bef59-d269-450e-8dc0-069165d83217} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=35, jobs=35). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:48086) (comment: 01083_window_view_select.sh) (in query: SELECT count(*) FROM wv), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 11:01:05.841732 [ 4401 ] {213bef59-d269-450e-8dc0-069165d83217} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=35, jobs=35). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 11:01:06.139275 [ 3355 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:01:07.141712 [ 3371 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:01:07.300811 [ 3855 ] {f6082ed4-a0a7-440e-9104-b6f345bcdafb} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:48110) (comment: 02401_merge_tree_old_tmp_dirs_cleanup.sql) (in query: INSERT INTO test_inserts SELECT sleep(1), number FROM numbers(10) SETTINGS max_insert_delayed_streams_for_parallel_write = 100, max_insert_block_size = 1, min_insert_block_size_rows = 1;), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:49: DB::threadFunction(DB::CompletedPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d512d1d 13. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:90: DB::CompletedPipelineExecutor::execute()::$_0::operator()() const @ 0x000000001d512baa 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d512b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::CompletedPipelineExecutor::execute()::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d512b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::CompletedPipelineExecutor::execute()::$_0&, std::tuple<>&) @ 0x000000001d512a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'()::operator()() @ 0x000000001d5129a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d512915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5128f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5128d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5128a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 11:01:07.357653 [ 3855 ] {f6082ed4-a0a7-440e-9104-b6f345bcdafb} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:49: DB::threadFunction(DB::CompletedPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d512d1d 13. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:90: DB::CompletedPipelineExecutor::execute()::$_0::operator()() const @ 0x000000001d512baa 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d512b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::CompletedPipelineExecutor::execute()::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d512b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::CompletedPipelineExecutor::execute()::$_0&, std::tuple<>&) @ 0x000000001d512a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'()::operator()() @ 0x000000001d5129a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d512915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5128f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5128d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5128a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 11:01:08.148628 [ 2882 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:01:09.158711 [ 2896 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:01:10.140249 [ 3751 ] {a0464cce-7929-4077-9770-d9e1c4565f6d} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=41, jobs=41). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:50622) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM system.processes WHERE query_id != queryID() AND current_database = currentDatabase() AND query LIKE '%-- 11317_tuple%'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 11:01:10.164976 [ 2912 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:01:10.237453 [ 3751 ] {a0464cce-7929-4077-9770-d9e1c4565f6d} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=41, jobs=41). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 11:01:10.425777 [ 3855 ] {a16cbdc2-b173-440f-93e8-523e7921f47d} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=9, jobs=9). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:50638) (comment: 01083_window_view_select.sh) (in query: SELECT count(*) FROM wv), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 11:01:10.449439 [ 3855 ] {a16cbdc2-b173-440f-93e8-523e7921f47d} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=9, jobs=9). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 11:01:10.518946 [ 6123 ] {4dd37c9e-72bb-4ee2-b7d4-b026f5204628} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:48078) (comment: 02319_no_columns_in_row_level_filter.sql) (in query: -- Run query under default user so that always false row_level_filter is added that doesn't require any columns SELECT count(1) FROM test_table;), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 11:01:10.545017 [ 6123 ] {4dd37c9e-72bb-4ee2-b7d4-b026f5204628} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 11:01:10.639666 [ 3868 ] {5f31f3bf-3875-4e4c-b3d3-99436b707b2a} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=1): While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:50618) (comment: 00068_subquery_in_prewhere.sql) (in query: SELECT count() FROM test.hits PREWHERE UserID IN (SELECT UserID FROM test.hits WHERE CounterID = 800784);), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1fc91 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1fb3b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1faf0 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1fab0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1fa3b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce216d1 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1f750 16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future> DB::scheduleFromThreadPoolUnsafe, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl>&, String const&, Priority) @ 0x000000001ce1f09c 17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1d6c3 18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl>*, unsigned long) @ 0x000000001ce1d5b3 19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6eeac 20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, void, void>(std::allocator&, DB::MergeTreeMarksLoader*, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6edb5 21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int>(std::allocator, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6ece3 22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], std::shared_ptr&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, void>(std::allocator const&, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6eb95 23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, void>(std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6e49b 24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&, std::function const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bed3 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bbdd 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bb9d 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bb5d 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bb28 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd6a7e 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd2efd 31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fd02d6 2024.12.16 11:01:10.897442 [ 3868 ] {5f31f3bf-3875-4e4c-b3d3-99436b707b2a} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=1): While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1fc91 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1fb3b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1faf0 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1fab0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1fa3b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce216d1 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1f750 16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future> DB::scheduleFromThreadPoolUnsafe, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl>&, String const&, Priority) @ 0x000000001ce1f09c 17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1d6c3 18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl>*, unsigned long) @ 0x000000001ce1d5b3 19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6eeac 20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, void, void>(std::allocator&, DB::MergeTreeMarksLoader*, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6edb5 21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int>(std::allocator, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6ece3 22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], std::shared_ptr&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, void>(std::allocator const&, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6eb95 23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, void>(std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6e49b 24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&, std::function const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bed3 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bbdd 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bb9d 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bb5d 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bb28 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd6a7e 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd2efd 31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fd02d6 2024.12.16 11:01:11.178892 [ 2937 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:01:12.198090 [ 2962 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:01:13.209093 [ 2977 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:01:14.262787 [ 2988 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:01:15.274107 [ 2985 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:01:15.511480 [ 3751 ] {55feb202-ca3a-46ee-bc15-300fcfeda872} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=25, jobs=25). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:50682) (comment: 01083_window_view_select.sh) (in query: SELECT count(*) FROM wv), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 11:01:15.559182 [ 3751 ] {55feb202-ca3a-46ee-bc15-300fcfeda872} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=25, jobs=25). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 11:01:15.803112 [ 4401 ] {89473f59-796e-419f-ad8d-e85ae0e5efa8} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=25, jobs=25). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:50668) (comment: 00081_group_by_without_key_and_totals.sql) (in query: SELECT count() AS c FROM test.hits WHERE CounterID = 1704509 WITH TOTALS SETTINGS totals_mode = 'before_having', max_rows_to_group_by = 100000, group_by_overflow_mode = 'any';), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 11:01:16.058766 [ 4401 ] {89473f59-796e-419f-ad8d-e85ae0e5efa8} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=25, jobs=25). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 11:01:16.280709 [ 3024 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:01:17.289659 [ 3046 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:01:18.233734 [ 3480 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {739a98fa-7c63-4e89-b17e-c4bb33c42ce9::202412_1_34_7}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergeTreePartition.cpp:441: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000001ce2fec6 21. /build/src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001ce2f078 22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:239: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39bb5 23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 24. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37f43 25. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb722bf 26. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb725d8 27. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb71fb2 28. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13ef38 29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x000000001cba15ed 30. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x000000001cba210e 31. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef, StrongTypedef, std::basic_string_view>)::'lambda'()::operator()() const @ 0x000000001cba9c78 (version 24.3.12.76.altinitystable) 2024.12.16 11:01:18.299552 [ 3058 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:01:18.789214 [ 3544 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=3). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:298: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd2eaf 21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set, std::equal_to, std::allocator>&) @ 0x000000001ccd371a 22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf3803a 23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d (version 24.3.12.76.altinitystable) 2024.12.16 11:01:19.301670 [ 2901 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:01:19.670045 [ 3547 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::TransactionsInfoLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:260: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf3a0a0 21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 (version 24.3.12.76.altinitystable) 2024.12.16 11:01:20.311228 [ 3045 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:01:20.575864 [ 3485 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {6f7c3cf6-8cd3-4e51-9114-2257622df7c4::202412_1_42_8}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1fc91 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1fb3b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1faf0 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1fab0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1fa3b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce216d1 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1f750 16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future> DB::scheduleFromThreadPoolUnsafe, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl>&, String const&, Priority) @ 0x000000001ce1f09c 17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1d6c3 18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl>*, unsigned long) @ 0x000000001ce1d5b3 19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*, unsigned long, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&&, unsigned long&&) @ 0x000000001ce56a2c 20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*, unsigned long, void, void>(std::allocator&, DB::MergeTreeMarksLoader*, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&&, unsigned long&&) @ 0x000000001ce56935 21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*, unsigned long>(std::allocator, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&&, unsigned long&&) @ 0x000000001ce56863 22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], std::shared_ptr&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*, unsigned long, void>(std::allocator const&, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&&, unsigned long&&) @ 0x000000001ce56715 23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*, unsigned long, void>(std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&&, unsigned long&&) @ 0x000000001ce53cbb 24. /build/src/Storages/MergeTree/MergeTreeReaderCompact.cpp:37: DB::MergeTreeReaderCompact::MergeTreeReaderCompact(std::shared_ptr, DB::NamesAndTypesList, std::unordered_map, std::equal_to, std::allocator>> const&, std::shared_ptr const&, DB::UncompressedCache*, DB::MarkCache*, DB::MarkRanges, DB::MergeTreeReaderSettings, std::map, std::allocator>>, std::function const&, int) @ 0x000000001ce51f0a 25. /build/src/Storages/MergeTree/MergeTreeReaderCompactSingleBuffer.h:16: DB::MergeTreeReaderCompactSingleBuffer::MergeTreeReaderCompactSingleBuffer&, DB::NamesAndTypesList const&, std::unordered_map, std::equal_to, std::allocator>> const&, std::shared_ptr const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map, std::allocator>> const&, std::function const&, int>(std::shared_ptr&, DB::NamesAndTypesList const&, std::unordered_map, std::equal_to, std::allocator>> const&, std::shared_ptr const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map, std::allocator>> const&, std::function const&, int&&) @ 0x000000001ccc27a5 26. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, DB::NamesAndTypesList const&, std::unordered_map, std::equal_to, std::allocator>> const&, std::shared_ptr const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map, std::allocator>> const&, std::function const&, int>(std::shared_ptr&, DB::NamesAndTypesList const&, std::unordered_map, std::equal_to, std::allocator>> const&, std::shared_ptr const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map, std::allocator>> const&, std::function const&, int&&) @ 0x000000001ccc1b7d 27. /build/src/Storages/MergeTree/MergeTreeDataPartCompact.cpp:43: DB::MergeTreeDataPartCompact::getReader(DB::NamesAndTypesList const&, std::shared_ptr const&, DB::MarkRanges const&, std::unordered_map, std::equal_to, std::allocator>> const&, DB::UncompressedCache*, DB::MarkCache*, std::shared_ptr const&, DB::MergeTreeReaderSettings const&, std::map, std::allocator>> const&, std::function const&) const @ 0x000000001ccbeef3 28. /build/src/Storages/MergeTree/MergeTreeSequentialSource.cpp:177: DB::MergeTreeSequentialSource::MergeTreeSequentialSource(DB::MergeTreeSequentialSourceType, DB::MergeTreeData const&, std::shared_ptr const&, std::shared_ptr, std::vector>, std::optional, bool, bool, bool, bool) @ 0x000000001ce71ef0 29. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeSequentialSource* std::construct_at[abi:v15000] const&, std::shared_ptr&, std::vector>&, std::optional, bool, bool&, bool&, bool&, DB::MergeTreeSequentialSource*>(DB::MergeTreeSequentialSource*, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr const&, std::shared_ptr&, std::vector>&, std::optional&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce76047 30. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000] const&, std::shared_ptr&, std::vector>&, std::optional, bool, bool&, bool&, bool&, void, void>(std::allocator&, DB::MergeTreeSequentialSource*, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr const&, std::shared_ptr&, std::vector>&, std::optional&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce75d04 31. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000] const&, std::shared_ptr&, std::vector>&, std::optional, bool, bool&, bool&, bool&>(std::allocator, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr const&, std::shared_ptr&, std::vector>&, std::optional&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce759b1 (version 24.3.12.76.altinitystable) 2024.12.16 11:01:20.763609 [ 4401 ] {24a1b6ba-0a38-417a-8847-8d64fcc4b5e0} executeQuery: Code: 80. DB::Exception: Cannot CREATE a table AS test_98wzuf3z.mv_from_base_to_target, it is a Materialized View without storage. Use "AS `test_98wzuf3z.target_table`" instead. (INCORRECT_QUERY) (version 24.3.12.76.altinitystable) (from [::1]:50694) (comment: 03161_create_table_as_mv.sql) (in query: CREATE TABLE other_table_2 AS mv_from_base_to_target;), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String const&, DB::QualifiedTableName&&) @ 0x000000001b02308c 6. /build/src/Interpreters/InterpreterCreateQuery.cpp:982: DB::InterpreterCreateQuery::setEngine(DB::ASTCreateQuery&) const @ 0x000000001b011dce 7. /build/src/Interpreters/InterpreterCreateQuery.cpp:723: DB::InterpreterCreateQuery::getTablePropertiesAndNormalizeCreateQuery(DB::ASTCreateQuery&) const @ 0x000000001b00f07c 8. /build/src/Interpreters/InterpreterCreateQuery.cpp:1221: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x000000001b016dc4 9. /build/src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x000000001b021096 10. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 11. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 12. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 13. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 14. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 15. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 16. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 17. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 18. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 19. ? @ 0x00007f713a222ac3 20. ? @ 0x00007f713a2b4850 2024.12.16 11:01:20.773381 [ 4401 ] {24a1b6ba-0a38-417a-8847-8d64fcc4b5e0} TCPHandler: Code: 80. DB::Exception: Cannot CREATE a table AS test_98wzuf3z.mv_from_base_to_target, it is a Materialized View without storage. Use "AS `test_98wzuf3z.target_table`" instead. (INCORRECT_QUERY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String const&, DB::QualifiedTableName&&) @ 0x000000001b02308c 6. /build/src/Interpreters/InterpreterCreateQuery.cpp:982: DB::InterpreterCreateQuery::setEngine(DB::ASTCreateQuery&) const @ 0x000000001b011dce 7. /build/src/Interpreters/InterpreterCreateQuery.cpp:723: DB::InterpreterCreateQuery::getTablePropertiesAndNormalizeCreateQuery(DB::ASTCreateQuery&) const @ 0x000000001b00f07c 8. /build/src/Interpreters/InterpreterCreateQuery.cpp:1221: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x000000001b016dc4 9. /build/src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x000000001b021096 10. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 11. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 12. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 13. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 14. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 15. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 16. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 17. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 18. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 19. ? @ 0x00007f713a222ac3 20. ? @ 0x00007f713a2b4850 2024.12.16 11:01:20.826713 [ 6123 ] {c057f6a5-ae2e-45f7-92b1-dd4c1e0bc4e6} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=37, jobs=37). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:56814) (comment: 01083_window_view_select.sh) (in query: SELECT count(*) FROM wv), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 11:01:20.852392 [ 6123 ] {c057f6a5-ae2e-45f7-92b1-dd4c1e0bc4e6} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=37, jobs=37). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 11:01:21.124948 [ 2756 ] {4eed35d1-540f-4a37-8349-7d9413bdd21c} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=13, jobs=2). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:56826) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM system.processes WHERE query_id != queryID() AND current_database = currentDatabase() AND query LIKE '%-- 11317_tuple%'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 11:01:21.204595 [ 2756 ] {4eed35d1-540f-4a37-8349-7d9413bdd21c} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=13, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 11:01:21.317957 [ 3108 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:01:22.334344 [ 3113 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:01:23.341546 [ 3123 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:01:23.341800 [ 3549 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::TextLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:323: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf3ae44 21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 (version 24.3.12.76.altinitystable) 2024.12.16 11:01:24.349422 [ 3138 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:01:24.837566 [ 3751 ] {4f271e37-45a0-44df-ab5a-3b455cbb9bb3} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=33, jobs=33). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:56858) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM system.processes WHERE query_id != queryID() AND current_database = currentDatabase() AND query LIKE '%-- 11317_tuple%'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 11:01:24.963267 [ 3751 ] {4f271e37-45a0-44df-ab5a-3b455cbb9bb3} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=33, jobs=33). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 11:01:25.352669 [ 3150 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:01:26.355232 [ 3161 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:01:27.357704 [ 3174 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:01:28.364839 [ 3194 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:01:29.382681 [ 3211 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:01:30.387990 [ 3218 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:01:30.677951 [ 2756 ] {3b7c6ad3-2ecb-42d1-8473-540a71f59a93} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=10, jobs=10). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:34510) (comment: 01083_window_view_select.sh) (in query: SELECT count(*) FROM wv), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 11:01:30.707200 [ 2756 ] {3b7c6ad3-2ecb-42d1-8473-540a71f59a93} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=10, jobs=10). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 11:01:31.396220 [ 3230 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:01:32.115596 [ 2756 ] {686ab26d-67b9-4650-9a72-31ddc5818e37} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=36). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:34518) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM system.processes WHERE query_id != queryID() AND current_database = currentDatabase() AND query LIKE '%-- 11317_tuple%'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 11:01:32.222173 [ 2756 ] {686ab26d-67b9-4650-9a72-31ddc5818e37} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=36). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 11:01:32.403412 [ 3247 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:01:32.643255 [ 3553 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:260: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf3a0a0 21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 (version 24.3.12.76.altinitystable) 2024.12.16 11:01:33.413708 [ 3260 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:01:34.415875 [ 3268 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:01:35.418113 [ 3276 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:01:35.525069 [ 3552 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:147: DB::IMergeTreeDataPart::MinMaxIndex::store(std::vector> const&, std::vector, std::allocator>> const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caad019 21. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:118: DB::IMergeTreeDataPart::MinMaxIndex::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caab9fb 22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:244: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39ccf 23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 26. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 (version 24.3.12.76.altinitystable) 2024.12.16 11:01:35.641851 [ 2756 ] {44235d68-c68d-40ad-87fc-d16e00e61760} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=39, jobs=39). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:34536) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM system.processes WHERE query_id != queryID() AND current_database = currentDatabase() AND query LIKE '%-- 11317_tuple%'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 11:01:35.641372 [ 5021 ] {d70540b1-a427-4a50-be4b-4430054464f4} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=6, jobs=6). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:34544) (comment: 01083_window_view_select.sh) (in query: SELECT count(*) FROM wv), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 11:01:35.693363 [ 5021 ] {d70540b1-a427-4a50-be4b-4430054464f4} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=6, jobs=6). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 11:01:35.856640 [ 2756 ] {44235d68-c68d-40ad-87fc-d16e00e61760} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=39, jobs=39). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 11:01:36.430572 [ 3285 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:01:36.692428 [ 3553 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:294: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf3a8b6 21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 (version 24.3.12.76.altinitystable) 2024.12.16 11:01:36.732662 [ 4402 ] {80cd97e9-f522-4eb1-ab79-e2258ea58de1} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=1, jobs=1). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:34568) (comment: 03155_analyzer_interpolate.sql) (in query: SELECT n, [number] AS inter FROM ( SELECT toFloat32(number % 10) AS n, number FROM numbers(10) WHERE number % 3 = 1 ) GROUP BY n, inter ORDER BY n WITH FILL FROM 0 TO 5.51 STEP 0.5 INTERPOLATE (inter AS [5]);), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 11:01:36.766009 [ 4402 ] {80cd97e9-f522-4eb1-ab79-e2258ea58de1} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=1, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 11:01:37.436783 [ 3304 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:01:38.444634 [ 3313 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:01:39.453203 [ 3328 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:01:39.456589 [ 3855 ] {fccef859-26a0-431c-be94-33aff3cdcb90} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=4, jobs=3). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:40054) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM system.processes WHERE query_id != queryID() AND current_database = currentDatabase() AND query LIKE '%-- 11317_tuple%'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 11:01:39.535505 [ 3855 ] {fccef859-26a0-431c-be94-33aff3cdcb90} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=4, jobs=3). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 11:01:40.464867 [ 3336 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:01:40.759133 [ 3855 ] {0b7372b1-66ae-42a1-ba7b-16e17868563e} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=4, jobs=4). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:40060) (comment: 01083_window_view_select.sh) (in query: SELECT count(*) FROM wv), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 11:01:40.775049 [ 3855 ] {0b7372b1-66ae-42a1-ba7b-16e17868563e} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=4, jobs=4). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 11:01:41.473726 [ 3351 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:01:42.480024 [ 3371 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:01:42.749781 [ 3855 ] {f0312a71-2bff-4a03-86ca-3f8c8f6f36c7} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=6, jobs=6). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:40080) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM system.processes WHERE query_id != queryID() AND current_database = currentDatabase() AND query LIKE '%-- 11317_tuple%'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 11:01:42.982645 [ 3855 ] {f0312a71-2bff-4a03-86ca-3f8c8f6f36c7} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=6, jobs=6). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 11:01:42.982759 [ 5021 ] {01156a04-8a78-4f56-bc7d-6d1299ed4cb8} executeQuery: Code: 47. DB::Exception: Unknown identifier 'xyz' inside COLUMNS matcher. In scope Scope node SELECT COLUMNS(bar, foo, xyz) APPLY length FROM test Identifier lookup to resolve state 2 Identifier foo EXPRESSION resolve result test_wlrbipye.test.foo place JOIN_TREE resolved from parent scopes 0 Identifier bar EXPRESSION resolve result test_wlrbipye.test.bar place JOIN_TREE resolved from parent scopes 0 Expression argument name to node 0 Alias name to expression node table size 0 Alias name to function node table size 0 Alias name to table expression node table size 0 CTE name to query node table size 0 WINDOW name to window node table size 0 Nodes with duplicated aliases size 0 Expression resolve process stack 1 Expression COLUMNS(bar, foo, xyz) APPLY length Table expressions in resolve process size 0 Non cached identifier lookups during expression resolve 0 Table expression node to data 1 Table expression node test_wlrbipye.test data Table expression name test_wlrbipye.test table expression description table database name test_wlrbipye table name test should qualify columns 1 columns size 10 Column name _block_number column node COLUMN id: 0, column_name: _block_number, result_type: UInt64, source_id: 1 Column name _row_exists column node COLUMN id: 0, column_name: _row_exists, result_type: UInt8, source_id: 1 Column name _part_offset column node COLUMN id: 0, column_name: _part_offset, result_type: UInt64, source_id: 1 Column name _sample_factor column node COLUMN id: 0, column_name: _sample_factor, result_type: Float64, source_id: 1 Column name _part_uuid column node COLUMN id: 0, column_name: _part_uuid, result_type: UUID, source_id: 1 Column name _partition_id column node COLUMN id: 0, column_name: _partition_id, result_type: LowCardinality(String), source_id: 1 Column name _part column node COLUMN id: 0, column_name: _part, result_type: LowCardinality(String), source_id: 1 Column name bar column node COLUMN id: 0, column_name: bar, result_type: String, source_id: 1 Column name _part_index column node COLUMN id: 0, column_name: _part_index, result_type: UInt64, source_id: 1 Column name foo column node COLUMN id: 0, column_name: foo, result_type: String, source_id: 1 Use identifier lookup to result cache 1 Subquery depth 0 . (UNKNOWN_IDENTIFIER) (version 24.3.12.76.altinitystable) (from [::1]:40076) (comment: 03152_analyzer_columns_list.sql) (in query: SELECT COLUMNS(bar, foo, xyz) APPLY (length) FROM test;), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String const&, String&&) @ 0x000000000b4fe4cc 6. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:4629: DB::(anonymous namespace)::QueryAnalyzer::resolveUnqualifiedMatcher(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0de91d 7. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:4840: DB::(anonymous namespace)::QueryAnalyzer::resolveMatcher(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0db2c0 8. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6450: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a2320 9. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a0a21 10. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0ab1c7 11. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09cd43 12. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001b09af74 13. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr&, std::shared_ptr) @ 0x000000001b09ac33 14. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr) @ 0x000000001b08c3a6 15. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr const&, DB::SelectQueryOptions const&, std::shared_ptr const&, std::shared_ptr const&) @ 0x000000001b507dac 16. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x000000001b5069e6 17. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr const&, DB::SelectQueryOptions const&) @ 0x000000001b509db7 18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50924c 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b5091fd 20. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b50919d 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b50915d 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b509125 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b428b1e 24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b42409d 25. /build/src/Interpreters/InterpreterFactory.cpp:355: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000001b42372d 26. /build/src/Interpreters/executeQuery.cpp:1133: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb1cb0 27. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 28. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 29. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 30. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 31. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 2024.12.16 11:01:43.002446 [ 5021 ] {01156a04-8a78-4f56-bc7d-6d1299ed4cb8} TCPHandler: Code: 47. DB::Exception: Unknown identifier 'xyz' inside COLUMNS matcher. In scope Scope node SELECT COLUMNS(bar, foo, xyz) APPLY length FROM test Identifier lookup to resolve state 2 Identifier foo EXPRESSION resolve result test_wlrbipye.test.foo place JOIN_TREE resolved from parent scopes 0 Identifier bar EXPRESSION resolve result test_wlrbipye.test.bar place JOIN_TREE resolved from parent scopes 0 Expression argument name to node 0 Alias name to expression node table size 0 Alias name to function node table size 0 Alias name to table expression node table size 0 CTE name to query node table size 0 WINDOW name to window node table size 0 Nodes with duplicated aliases size 0 Expression resolve process stack 1 Expression COLUMNS(bar, foo, xyz) APPLY length Table expressions in resolve process size 0 Non cached identifier lookups during expression resolve 0 Table expression node to data 1 Table expression node test_wlrbipye.test data Table expression name test_wlrbipye.test table expression description table database name test_wlrbipye table name test should qualify columns 1 columns size 10 Column name _block_number column node COLUMN id: 0, column_name: _block_number, result_type: UInt64, source_id: 1 Column name _row_exists column node COLUMN id: 0, column_name: _row_exists, result_type: UInt8, source_id: 1 Column name _part_offset column node COLUMN id: 0, column_name: _part_offset, result_type: UInt64, source_id: 1 Column name _sample_factor column node COLUMN id: 0, column_name: _sample_factor, result_type: Float64, source_id: 1 Column name _part_uuid column node COLUMN id: 0, column_name: _part_uuid, result_type: UUID, source_id: 1 Column name _partition_id column node COLUMN id: 0, column_name: _partition_id, result_type: LowCardinality(String), source_id: 1 Column name _part column node COLUMN id: 0, column_name: _part, result_type: LowCardinality(String), source_id: 1 Column name bar column node COLUMN id: 0, column_name: bar, result_type: String, source_id: 1 Column name _part_index column node COLUMN id: 0, column_name: _part_index, result_type: UInt64, source_id: 1 Column name foo column node COLUMN id: 0, column_name: foo, result_type: String, source_id: 1 Use identifier lookup to result cache 1 Subquery depth 0 . (UNKNOWN_IDENTIFIER), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String const&, String&&) @ 0x000000000b4fe4cc 6. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:4629: DB::(anonymous namespace)::QueryAnalyzer::resolveUnqualifiedMatcher(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0de91d 7. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:4840: DB::(anonymous namespace)::QueryAnalyzer::resolveMatcher(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0db2c0 8. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6450: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a2320 9. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a0a21 10. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0ab1c7 11. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09cd43 12. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001b09af74 13. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr&, std::shared_ptr) @ 0x000000001b09ac33 14. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr) @ 0x000000001b08c3a6 15. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr const&, DB::SelectQueryOptions const&, std::shared_ptr const&, std::shared_ptr const&) @ 0x000000001b507dac 16. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x000000001b5069e6 17. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr const&, DB::SelectQueryOptions const&) @ 0x000000001b509db7 18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50924c 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b5091fd 20. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b50919d 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b50915d 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b509125 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b428b1e 24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b42409d 25. /build/src/Interpreters/InterpreterFactory.cpp:355: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000001b42372d 26. /build/src/Interpreters/executeQuery.cpp:1133: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb1cb0 27. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 28. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 29. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 30. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 31. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 2024.12.16 11:01:43.486432 [ 2884 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:01:43.913415 [ 3564 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::QueryViewsLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:323: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf3ae44 21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 (version 24.3.12.76.altinitystable) 2024.12.16 11:01:44.500294 [ 2907 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:01:45.508026 [ 2931 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:01:46.511275 [ 2944 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:01:47.513694 [ 2952 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:01:48.522333 [ 2986 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:01:49.529572 [ 3008 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:01:49.858181 [ 5021 ] {74aa7e29-409f-4c2c-8cc8-1d8cdbefeae8} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:34038) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM system.processes WHERE query_id != queryID() AND current_database = currentDatabase() AND query LIKE '%-- 11317_tuple%'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 11:01:49.927934 [ 5021 ] {74aa7e29-409f-4c2c-8cc8-1d8cdbefeae8} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 11:01:50.536908 [ 3020 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:01:50.621902 [ 2756 ] {4bac2259-dc36-4cf7-aef0-f28642ef4bab} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=6, jobs=6). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:34062) (comment: 01083_window_view_select.sh) (in query: SELECT count(*) FROM wv), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 11:01:50.641362 [ 2756 ] {4bac2259-dc36-4cf7-aef0-f28642ef4bab} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=6, jobs=6). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 11:01:51.544515 [ 3041 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:01:52.550055 [ 3056 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:01:52.627359 [ 2756 ] {4cf44581-4986-4d7c-8a0d-55ebf9d549be} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=2, jobs=2). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::ffff:127.0.0.1]:48462) (comment: 00177_memory_bound_merging.sh) (in query: SELECT `__table1`.`URL` AS `URL`, `__table1`.`EventDate` AS `EventDate`, `__table1`.`URL` AS `max(URL)` FROM `test`.`hits` AS `__table1` WHERE (`__table1`.`CounterID` = 1704509) AND (`__table1`.`UserID` = 4322253409885123546) GROUP BY `__table1`.`URL`, `__table1`.`EventDate` ORDER BY `__table1`.`URL` ASC, `__table1`.`EventDate` ASC LIMIT _CAST(10, 'UInt64'), _CAST(5, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 11:01:52.637264 [ 2756 ] {4cf44581-4986-4d7c-8a0d-55ebf9d549be} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=2, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 11:01:52.643618 [ 4182 ] {} ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:56452). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x00000000134e6f2c 6. /build/src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x00000000134e60a0 7. /build/src/IO/ReadBuffer.h:70: DB::ReadBuffer::next() @ 0x000000000af5ec6a 8. /build/src/IO/ReadBuffer.h:106: DB::TCPHandler::runImpl() @ 0x000000001d46ea77 9. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 10. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 11. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 12. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 13. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 14. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 15. ? @ 0x00007f713a222ac3 16. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:01:52.667928 [ 5021 ] {} ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:56446). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x00000000134e6f2c 6. /build/src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x00000000134e60a0 7. /build/src/IO/ReadBuffer.h:70: DB::ReadBuffer::next() @ 0x000000000af5ec6a 8. /build/src/IO/ReadBuffer.h:106: void DB::varint_impl::readVarUInt(unsigned long&, DB::ReadBuffer&) @ 0x000000001335d78f 9. /build/src/IO/VarInt.h:111: DB::readVarUInt(unsigned long&, DB::ReadBuffer&) @ 0x000000001335d4ec 10. /build/src/IO/ReadHelpers.h:144: DB::readStringBinary(String&, DB::ReadBuffer&, unsigned long) @ 0x0000000013381fac 11. /build/src/Server/TCPHandler.cpp:0: DB::TCPHandler::receiveAddendum() @ 0x000000001d4793f4 12. /build/src/Server/TCPHandler.cpp:279: DB::TCPHandler::runImpl() @ 0x000000001d46cdf2 13. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 14. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 15. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 16. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 17. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 18. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 19. ? @ 0x00007f713a222ac3 20. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:01:52.706886 [ 3731 ] {query_id_memory_bound_merging_2836531463} executeQuery: Code: 439. DB::Exception: Received from 127.0.0.1:9000. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=2, jobs=2). Stack trace: 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 : While executing Remote. (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:34050) (comment: 00177_memory_bound_merging.sh) (in query: SELECT URL, EventDate, max(URL) FROM remote(test_cluster_one_shard_two_replicas, test.hits) WHERE CounterID = 1704509 AND UserID = 4322253409885123546 GROUP BY URL, EventDate ORDER BY URL, EventDate LIMIT 5 OFFSET 10 SETTINGS optimize_aggregation_in_order = 1, enable_memory_bound_merging_of_aggregation_results = 1, allow_experimental_parallel_reading_from_replicas = 1, parallel_replicas_for_non_replicated_merge_tree = 1, max_parallel_replicas = 3, query_plan_aggregation_in_order = 1), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:89: DB::Exception::Exception(String const&, int, bool) @ 0x000000000a942caa 5. /build/src/Common/Exception.h:97: DB::Exception::createDeprecated(String const&, int, bool) @ 0x000000000a942c55 6. /build/src/IO/ReadHelpers.cpp:1560: DB::readException(DB::ReadBuffer&, String const&, bool) @ 0x0000000013369f82 7. /build/src/Client/Connection.cpp:1233: DB::Connection::receiveException() const @ 0x000000001d2bdc59 8. /build/src/Client/Connection.cpp:1070: DB::Connection::receivePacket() @ 0x000000001d2c51b1 9. /build/src/Client/PacketReceiver.cpp:66: DB::PacketReceiver::Task::run(std::function, std::function) @ 0x000000001d3320a4 10. /build/src/Common/AsyncTaskExecutor.cpp:88: DB::AsyncTaskExecutor::Routine::operator()(std::function) @ 0x0000000019ebde69 11. /build/src/Common/Fiber.h:76: Fiber::RoutineImpl::operator()(boost::context::fiber&&) @ 0x0000000019ebdd78 12. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019ebdd08 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:531: ? @ 0x0000000019ebdcc8 14. /build/contrib/boost/boost/context/fiber_fcontext.hpp:157: boost::context::detail::fiber_record>::run(void*) @ 0x0000000019ebdbfe 15. /build/contrib/boost/boost/context/fiber_fcontext.hpp:97: void boost::context::detail::fiber_entry>>(boost::context::detail::transfer_t) @ 0x0000000019ebd91d 2024.12.16 11:01:52.761722 [ 3731 ] {query_id_memory_bound_merging_2836531463} TCPHandler: Code: 439. DB::Exception: Received from 127.0.0.1:9000. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=2, jobs=2). Stack trace: 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 : While executing Remote. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:89: DB::Exception::Exception(String const&, int, bool) @ 0x000000000a942caa 5. /build/src/Common/Exception.h:97: DB::Exception::createDeprecated(String const&, int, bool) @ 0x000000000a942c55 6. /build/src/IO/ReadHelpers.cpp:1560: DB::readException(DB::ReadBuffer&, String const&, bool) @ 0x0000000013369f82 7. /build/src/Client/Connection.cpp:1233: DB::Connection::receiveException() const @ 0x000000001d2bdc59 8. /build/src/Client/Connection.cpp:1070: DB::Connection::receivePacket() @ 0x000000001d2c51b1 9. /build/src/Client/PacketReceiver.cpp:66: DB::PacketReceiver::Task::run(std::function, std::function) @ 0x000000001d3320a4 10. /build/src/Common/AsyncTaskExecutor.cpp:88: DB::AsyncTaskExecutor::Routine::operator()(std::function) @ 0x0000000019ebde69 11. /build/src/Common/Fiber.h:76: Fiber::RoutineImpl::operator()(boost::context::fiber&&) @ 0x0000000019ebdd78 12. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019ebdd08 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:531: ? @ 0x0000000019ebdcc8 14. /build/contrib/boost/boost/context/fiber_fcontext.hpp:157: boost::context::detail::fiber_record>::run(void*) @ 0x0000000019ebdbfe 15. /build/contrib/boost/boost/context/fiber_fcontext.hpp:97: void boost::context::detail::fiber_entry>>(boost::context::detail::transfer_t) @ 0x0000000019ebd91d 2024.12.16 11:01:53.553402 [ 3076 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:01:53.557486 [ 2756 ] {e6e5cb52-4789-42cf-9747-d4855f90b56a} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=4, jobs=4). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:34082) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM system.processes WHERE query_id != queryID() AND current_database = currentDatabase() AND query LIKE '%-- 11317_tuple%'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 11:01:53.640904 [ 2756 ] {e6e5cb52-4789-42cf-9747-d4855f90b56a} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=4, jobs=4). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 11:01:54.559868 [ 2982 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:01:54.908451 [ 2756 ] {b9660f84-3604-492a-8f5f-6c3b27c6028f} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=0). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:34096) (comment: 03151_redundant_distinct_with_window.sql) (in query: CREATE TABLE tab (`id` Int32, `val` Nullable(Float64), `dt` Nullable(DateTime64(6)), `type` Nullable(Int32)) ENGINE = MergeTree ORDER BY id SETTINGS index_granularity = 19513, min_bytes_for_wide_part = 1073741824, ratio_of_defaults_for_sparse_serialization = 0., replace_long_file_name_to_hash = true, max_file_name_length = 0, min_bytes_for_full_part_storage = 267011699, compact_parts_max_bytes_to_buffer = 528000792, compact_parts_max_granules_to_buffer = 256, compact_parts_merge_max_bytes_to_prefetch_part = 9672142, merge_max_block_size = 9405, old_parts_lifetime = 480., prefer_fetch_merged_part_size_threshold = 10737418240, vertical_merge_algorithm_min_rows_to_activate = 1000000, vertical_merge_algorithm_min_columns_to_activate = 100, min_merge_bytes_to_use_direct_io = 2389941665, index_granularity_bytes = 30373804, concurrent_part_removal_threshold = 100, allow_vertical_merges_from_compact_to_wide_parts = true, cache_populated_by_fetch = true, marks_compress_block_size = 35789, primary_key_compress_block_size = 36591), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/IO/WriteBufferFromFileDecorator.cpp:0: DB::WriteBufferFromFileDecorator::finalizeImpl() @ 0x000000001a358847 21. /build/src/Disks/IO/WriteBufferWithFinalizeCallback.cpp:18: DB::WriteBufferWithFinalizeCallback::finalizeImpl() @ 0x000000001a3585b9 22. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 23. /build/src/Storages/MergeTree/MergeTreeData.cpp:306: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x000000001cbadd42 24. /build/src/Storages/StorageMergeTree.cpp:117: DB::StorageMergeTree::StorageMergeTree(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, DB::LoadingStrictnessLevel, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>) @ 0x000000001d0eb1d1 25. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageMergeTree* std::construct_at[abi:v15000]&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, DB::StorageMergeTree*>(DB::StorageMergeTree*, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&) @ 0x000000001d0eabb7 26. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000]&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, void, void>(std::allocator&, DB::StorageMergeTree*, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&) @ 0x000000001d0ea8c7 27. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000]&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>>(std::allocator, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&) @ 0x000000001d0ea575 28. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, void>(std::allocator const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&) @ 0x000000001d0ea3a7 29. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000]&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, void>(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&) @ 0x000000001d0e756d 30. /build/src/Storages/MergeTree/registerStorageMergeTree.cpp:741: DB::create(DB::StorageFactory::Arguments const&) @ 0x000000001d0e50aa 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019307efd 2024.12.16 11:01:54.968640 [ 2756 ] {b9660f84-3604-492a-8f5f-6c3b27c6028f} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/IO/WriteBufferFromFileDecorator.cpp:0: DB::WriteBufferFromFileDecorator::finalizeImpl() @ 0x000000001a358847 21. /build/src/Disks/IO/WriteBufferWithFinalizeCallback.cpp:18: DB::WriteBufferWithFinalizeCallback::finalizeImpl() @ 0x000000001a3585b9 22. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 23. /build/src/Storages/MergeTree/MergeTreeData.cpp:306: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x000000001cbadd42 24. /build/src/Storages/StorageMergeTree.cpp:117: DB::StorageMergeTree::StorageMergeTree(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, DB::LoadingStrictnessLevel, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>) @ 0x000000001d0eb1d1 25. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageMergeTree* std::construct_at[abi:v15000]&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, DB::StorageMergeTree*>(DB::StorageMergeTree*, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&) @ 0x000000001d0eabb7 26. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000]&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, void, void>(std::allocator&, DB::StorageMergeTree*, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&) @ 0x000000001d0ea8c7 27. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000]&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>>(std::allocator, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&) @ 0x000000001d0ea575 28. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, void>(std::allocator const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&) @ 0x000000001d0ea3a7 29. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000]&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, void>(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&) @ 0x000000001d0e756d 30. /build/src/Storages/MergeTree/registerStorageMergeTree.cpp:741: DB::create(DB::StorageFactory::Arguments const&) @ 0x000000001d0e50aa 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019307efd 2024.12.16 11:01:55.566268 [ 2992 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:01:55.767069 [ 2756 ] {ef1786fc-7a42-48df-be1c-c383147334fa} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=5, jobs=5). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:34104) (comment: 01083_window_view_select.sh) (in query: SELECT count(*) FROM wv), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 11:01:55.811261 [ 2756 ] {ef1786fc-7a42-48df-be1c-c383147334fa} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=5, jobs=5). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 11:01:56.570999 [ 3087 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:01:57.398383 [ 4402 ] {7c390c16-1a3d-4d2a-a78b-18d3c3c7cf25} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=36). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:34116) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM system.processes WHERE query_id != queryID() AND current_database = currentDatabase() AND query LIKE '%-- 11317_tuple%'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 11:01:57.463966 [ 4402 ] {7c390c16-1a3d-4d2a-a78b-18d3c3c7cf25} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=36). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 11:01:57.573870 [ 3105 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:01:58.592786 [ 3127 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:01:59.595056 [ 3144 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:02:00.415020 [ 4402 ] {8d6b3685-3669-4abb-9e2c-359038a5fbf8} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=3, jobs=3). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:57652) (comment: 03151_pmj_join_non_procssed_clash.sql) (in query: SELECT count(ignore(*)), sum(t1.a), sum(t1.b), sum(t2.a) FROM ( SELECT number AS a, number AS b FROM numbers(10000) ) t1 JOIN ( SELECT number + 100 AS a FROM numbers(10000) ) t2 ON t1.a = t2.a AND t1.b > 0;), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 11:02:00.594946 [ 4402 ] {8d6b3685-3669-4abb-9e2c-359038a5fbf8} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=3, jobs=3). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 11:02:00.597436 [ 3151 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:02:01.017499 [ 4182 ] {71ec727e-5b19-4ac4-bb57-be6a7f3ea057} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=23, jobs=23). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:57654) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM system.processes WHERE query_id != queryID() AND current_database = currentDatabase() AND query LIKE '%-- 11317_tuple%'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 11:02:01.053990 [ 3487 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {41d82839-5472-4425-b891-a2dc2a236577::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=40, jobs=0): (while reading column PageViews): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/41d/41d82839-5472-4425-b891-a2dc2a236577/201403_4_4_0/ in table test.visits (41d82839-5472-4425-b891-a2dc2a236577) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 6741): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe(ThreadPoolImpl>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e92e1 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e917b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e9130 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e90f0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e907b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190eadb1 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e8d90 16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future DB::scheduleFromThreadPoolUnsafe(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl>&, String const&, Priority) @ 0x00000000190e861c 17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e7e3f 18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019365312 19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936561e 20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddc44d 21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6d168 22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6cfbd 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6cf7d 24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6cf3d 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6cf08 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd6a7e 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd2efd 28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fd02d6 29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function const&, std::shared_ptr const&, COW::immutable_ptr const&) const @ 0x0000000019fd045c 30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr const&, unsigned long, bool, unsigned long, std::unordered_map::immutable_ptr, std::hash, std::equal_to, std::allocator::immutable_ptr>>>&) @ 0x000000001ce6ab9b 31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce6a910 (version 24.3.12.76.altinitystable) 2024.12.16 11:02:01.075745 [ 4182 ] {71ec727e-5b19-4ac4-bb57-be6a7f3ea057} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=23, jobs=23). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 11:02:01.610260 [ 3139 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:02:02.612836 [ 3180 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:02:03.614896 [ 3179 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:02:04.616926 [ 3212 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:02:05.626256 [ 3210 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:02:06.675147 [ 3238 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:02:07.680585 [ 3264 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:02:08.583959 [ 3731 ] {255b18fa-176b-454f-8d78-47427c66acfe} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=5). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::ffff:127.0.0.1]:39238) (comment: 02725_async_insert_table_setting.sh) (in query: INSERT INTO t_mt_sync_insert VALUES ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:323: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf3ae44 21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 2024.12.16 11:02:08.616762 [ 3731 ] {255b18fa-176b-454f-8d78-47427c66acfe} DynamicQueryHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=5). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:323: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf3ae44 21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 (version 24.3.12.76.altinitystable) 2024.12.16 11:02:08.704440 [ 3287 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:02:09.540119 [ 4402 ] {4c0aee9c-6c97-411a-87a1-a78f2b853ffb} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=8, jobs=8). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:54496) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM system.processes WHERE query_id != queryID() AND current_database = currentDatabase() AND query LIKE '%-- 11317_tuple%'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 11:02:09.649381 [ 4402 ] {4c0aee9c-6c97-411a-87a1-a78f2b853ffb} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=8, jobs=8). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 11:02:09.707040 [ 3298 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:02:10.709198 [ 3262 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:02:11.712771 [ 3338 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:02:11.925843 [ 3731 ] {e5fa6fc8-ef22-4eab-a104-24a531251eff} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=28, jobs=28). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:54504) (comment: 01083_window_view_select.sh) (in query: SELECT count(*) FROM wv), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 11:02:12.387720 [ 5023 ] {ba9cb97a-8349-4d09-8dce-64d0038bf146} executeQuery: Code: 36. DB::Exception: Window 'w' is already defined. In scope SELECT count(*) OVER w FROM users WINDOW w AS (ORDER BY uid ASC), w AS (ORDER BY name ASC). (BAD_ARGUMENTS) (version 24.3.12.76.altinitystable) (from [::1]:57682) (comment: 03149_analyzer_window_redefinition.sql) (in query: SELECT count(*) OVER w FROM users WINDOW w AS (ORDER BY uid), w AS(ORDER BY name);), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String const&, String&&) @ 0x000000000b4fe4cc 6. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8137: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09cb89 7. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001b09af74 8. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr&, std::shared_ptr) @ 0x000000001b09ac33 9. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr) @ 0x000000001b08c3a6 10. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr const&, DB::SelectQueryOptions const&, std::shared_ptr const&, std::shared_ptr const&) @ 0x000000001b507dac 11. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x000000001b5069e6 12. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr const&, DB::SelectQueryOptions const&) @ 0x000000001b509db7 13. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50924c 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b5091fd 15. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b50919d 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b50915d 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b509125 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b428b1e 19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b42409d 20. /build/src/Interpreters/InterpreterFactory.cpp:355: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000001b42372d 21. /build/src/Interpreters/executeQuery.cpp:1133: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb1cb0 22. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 23. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 24. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 25. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 26. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 27. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 28. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 29. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 30. ? @ 0x00007f713a222ac3 31. ? @ 0x00007f713a2b4850 2024.12.16 11:02:12.392422 [ 3731 ] {e5fa6fc8-ef22-4eab-a104-24a531251eff} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=28, jobs=28). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 11:02:12.394197 [ 5023 ] {ba9cb97a-8349-4d09-8dce-64d0038bf146} TCPHandler: Code: 36. DB::Exception: Window 'w' is already defined. In scope SELECT count(*) OVER w FROM users WINDOW w AS (ORDER BY uid ASC), w AS (ORDER BY name ASC). (BAD_ARGUMENTS), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String const&, String&&) @ 0x000000000b4fe4cc 6. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8137: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09cb89 7. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001b09af74 8. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr&, std::shared_ptr) @ 0x000000001b09ac33 9. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr) @ 0x000000001b08c3a6 10. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr const&, DB::SelectQueryOptions const&, std::shared_ptr const&, std::shared_ptr const&) @ 0x000000001b507dac 11. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x000000001b5069e6 12. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000]&, std::shared_ptr const&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr const&, DB::SelectQueryOptions const&) @ 0x000000001b509db7 13. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50924c 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b5091fd 15. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b50919d 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b50915d 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b509125 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b428b1e 19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b42409d 20. /build/src/Interpreters/InterpreterFactory.cpp:355: DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x000000001b42372d 21. /build/src/Interpreters/executeQuery.cpp:1133: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb1cb0 22. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 23. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 24. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 25. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 26. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 27. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 28. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 29. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 30. ? @ 0x00007f713a222ac3 31. ? @ 0x00007f713a2b4850 2024.12.16 11:02:12.715188 [ 3359 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:02:12.850661 [ 4401 ] {4646b2ad-a63c-4b6d-96d6-ac9be712ab48} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=15, jobs=15). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:54518) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM system.processes WHERE query_id != queryID() AND current_database = currentDatabase() AND query LIKE '%-- 11317_tuple%'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 11:02:13.001405 [ 4401 ] {4646b2ad-a63c-4b6d-96d6-ac9be712ab48} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=15, jobs=15). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 11:02:13.379804 [ 3485 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {3035f09f-9767-4f79-a76a-3926d52c39f7::202412_1_66_13}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:323: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf3ae44 21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37f43 23. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb722bf 24. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb725d8 25. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb71fb2 26. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13ef38 27. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x000000001cba15ed 28. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x000000001cba210e 29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef, StrongTypedef, std::basic_string_view>)::'lambda'()::operator()() const @ 0x000000001cba9c78 30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba9c55 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001cba9c35 (version 24.3.12.76.altinitystable) 2024.12.16 11:02:13.725726 [ 3372 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:02:14.742732 [ 2877 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:02:15.750209 [ 2888 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:02:16.763736 [ 2889 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:02:17.015926 [ 4401 ] {2ef38034-deb6-4db9-9e65-eb2ea2a0b221} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=13, jobs=13). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:54550) (comment: 01083_window_view_select.sh) (in query: SELECT count(*) FROM wv), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 11:02:17.052909 [ 4401 ] {2ef38034-deb6-4db9-9e65-eb2ea2a0b221} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=13, jobs=13). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d516031 11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d5171d8 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d517135 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d517115 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5170f5 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5170c0 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 2024.12.16 11:02:17.318535 [ 3551 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::ProcessorProfileLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergeTreePartition.cpp:441: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000001ce2fec6 21. /build/src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001ce2f078 22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:239: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39bb5 23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 26. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 (version 24.3.12.76.altinitystable) 2024.12.16 11:02:17.766098 [ 2921 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:02:18.768350 [ 2942 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:02:19.778901 [ 2959 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:02:20.742578 [ 3731 ] {0c84cfe3-a78d-4185-a864-cd3bd7d41f4d} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=5): While executing MergeTreeSelect(pool: ReadPoolInOrder, algorithm: InOrder). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:54524) (comment: 00089_position_functions_with_non_constant_arg.sql) (in query: SELECT count() FROM test.hits WHERE position(URL, 'metrika') != position(URL, materialize('metrika'));), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1fc91 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1fb3b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1faf0 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1fab0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1fa3b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce216d1 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1f750 16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future> DB::scheduleFromThreadPoolUnsafe, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl>&, String const&, Priority) @ 0x000000001ce1f09c 17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1d6c3 18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl>*, unsigned long) @ 0x000000001ce1d5b3 19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6eeac 20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, void, void>(std::allocator&, DB::MergeTreeMarksLoader*, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6edb5 21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int>(std::allocator, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6ece3 22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], std::shared_ptr&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, void>(std::allocator const&, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6eb95 23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, void>(std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6e49b 24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&, std::function const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bed3 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bbdd 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bb9d 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bb5d 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bb28 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd6a7e 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd2efd 31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fd02d6 2024.12.16 11:02:20.793303 [ 2968 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:02:21.524976 [ 3731 ] {0c84cfe3-a78d-4185-a864-cd3bd7d41f4d} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=5): While executing MergeTreeSelect(pool: ReadPoolInOrder, algorithm: InOrder). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1fc91 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1fb3b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1faf0 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1fab0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1fa3b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce216d1 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1f750 16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future> DB::scheduleFromThreadPoolUnsafe, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl>&, String const&, Priority) @ 0x000000001ce1f09c 17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1d6c3 18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl>*, unsigned long) @ 0x000000001ce1d5b3 19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6eeac 20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, void, void>(std::allocator&, DB::MergeTreeMarksLoader*, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6edb5 21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int>(std::allocator, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6ece3 22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], std::shared_ptr&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, void>(std::allocator const&, std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6eb95 23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000]&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int, void>(std::shared_ptr&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl>*&, int&&) @ 0x000000001ce6e49b 24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr const&, std::function const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bed3 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bbdd 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bb9d 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bb5d 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bb28 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd6a7e 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd2efd 31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fd02d6 2024.12.16 11:02:21.804752 [ 2994 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:02:22.806639 [ 2985 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:02:23.808423 [ 3024 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:02:24.086917 [ 3553 ] {} void DB::SystemLog::flushImpl(const std::vector &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:323: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf3ae44 21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr, long, bool) @ 0x000000001cf872b3 23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001cf8365d 24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13bd8f 25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbd625 26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da41bfc 27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da41bb5 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da41b95 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da41b75 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da41b3d 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 (version 24.3.12.76.altinitystable) 2024.12.16 11:02:24.839394 [ 3041 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:02:24.966368 [ 3487 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {fe54ed48-ddd9-4cf8-aa3b-418c81cf437c::202412_74_89_3}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:286: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf3a6fb 21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf38f99 22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37f43 23. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb722bf 24. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb725d8 25. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb71fb2 26. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13ef38 27. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x000000001cba15ed 28. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x000000001cba210e 29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef, StrongTypedef, std::basic_string_view>)::'lambda'()::operator()() const @ 0x000000001cba9c78 30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba9c55 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001cba9c35 (version 24.3.12.76.altinitystable) 2024.12.16 11:02:25.851009 [ 3049 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:02:26.861303 [ 3072 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:02:27.710756 [ 3751 ] {861ff074-6cfc-4407-816d-ee050b3d3591} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=37, jobs=37). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:56898) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM system.processes WHERE query_id != queryID() AND current_database = currentDatabase() AND query LIKE '%-- 11317_tuple%'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 11:02:27.855302 [ 3751 ] {861ff074-6cfc-4407-816d-ee050b3d3591} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=37, jobs=37). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 11:02:27.863972 [ 3035 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:02:28.866292 [ 2929 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:02:29.868802 [ 3022 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:02:30.876758 [ 3100 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:02:31.371602 [ 5023 ] {e4c0eedc-1f00-4eb6-b76a-6b113cab2725} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=12, jobs=12). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:53022) (comment: 01114_database_atomic.sh) (in query: SELECT count() FROM system.processes WHERE query_id != queryID() AND current_database = currentDatabase() AND query LIKE '%-- 11317_tuple%'), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 11:02:31.435392 [ 5023 ] {e4c0eedc-1f00-4eb6-b76a-6b113cab2725} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=12, jobs=12). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d721e 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 11:02:31.755805 [ 3751 ] {af1c549b-b0d9-41ac-a370-df41d8c64d5d} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=2, jobs=2). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:53038) (comment: 00153_aggregate_arena_race.sql) (in query: insert into dest00153 select groupUniqArrayState(RefererDomain) from test.hits group by URLDomain;), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:748: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector, std::allocator>>&&, std::vector, std::allocator>>&&, std::shared_ptr, std::shared_ptr const&, DB::KeyCondition const&, std::optional const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, std::shared_ptr, unsigned long, std::vector>&, bool) @ 0x000000001cd10135 10. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1671: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector, std::allocator>>, std::vector, std::allocator>>, std::shared_ptr const&, DB::SelectQueryInfo const&, std::shared_ptr, unsigned long, std::shared_ptr, std::equal_to, std::allocator>>>, DB::MergeTreeData const&, std::vector> const&, std::shared_ptr, std::optional&) @ 0x000000001dd5ebc4 11. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1570: DB::ReadFromMergeTree::selectRangesToRead(std::vector, std::allocator>>, std::vector, std::allocator>>, std::shared_ptr const&, DB::SelectQueryInfo const&, std::shared_ptr, unsigned long, std::shared_ptr, std::equal_to, std::allocator>>>, DB::MergeTreeData const&, std::vector> const&, std::shared_ptr, std::optional&) @ 0x000000001dd5b86f 12. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1371: DB::ReadFromMergeTree::selectRangesToRead(std::vector, std::allocator>>, std::vector, std::allocator>>) const @ 0x000000001dd5b69e 13. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1854: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000001dd6148c 14. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1969: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd624fb 15. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector>, std::allocator>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd08c90 16. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3371f 17. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b508741 18. /build/src/Interpreters/InterpreterInsertQuery.cpp:508: DB::InterpreterInsertQuery::execute() @ 0x000000001b42cd70 19. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 20. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 21. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 22. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 23. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 24. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 25. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 26. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 27. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 28. ? @ 0x00007f713a222ac3 29. ? @ 0x00007f713a2b4850 2024.12.16 11:02:31.967259 [ 3751 ] {af1c549b-b0d9-41ac-a370-df41d8c64d5d} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=2, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:748: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector, std::allocator>>&&, std::vector, std::allocator>>&&, std::shared_ptr, std::shared_ptr const&, DB::KeyCondition const&, std::optional const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, std::shared_ptr, unsigned long, std::vector>&, bool) @ 0x000000001cd10135 10. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1671: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector, std::allocator>>, std::vector, std::allocator>>, std::shared_ptr const&, DB::SelectQueryInfo const&, std::shared_ptr, unsigned long, std::shared_ptr, std::equal_to, std::allocator>>>, DB::MergeTreeData const&, std::vector> const&, std::shared_ptr, std::optional&) @ 0x000000001dd5ebc4 11. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1570: DB::ReadFromMergeTree::selectRangesToRead(std::vector, std::allocator>>, std::vector, std::allocator>>, std::shared_ptr const&, DB::SelectQueryInfo const&, std::shared_ptr, unsigned long, std::shared_ptr, std::equal_to, std::allocator>>>, DB::MergeTreeData const&, std::vector> const&, std::shared_ptr, std::optional&) @ 0x000000001dd5b86f 12. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1371: DB::ReadFromMergeTree::selectRangesToRead(std::vector, std::allocator>>, std::vector, std::allocator>>) const @ 0x000000001dd5b69e 13. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1854: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000001dd6148c 14. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1969: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd624fb 15. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector>, std::allocator>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd08c90 16. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3371f 17. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b508741 18. /build/src/Interpreters/InterpreterInsertQuery.cpp:508: DB::InterpreterInsertQuery::execute() @ 0x000000001b42cd70 19. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 20. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 21. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 22. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 23. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 24. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 25. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 26. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 27. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 28. ? @ 0x00007f713a222ac3 29. ? @ 0x00007f713a2b4850 2024.12.16 11:02:31.975933 [ 2754 ] {} BaseDaemon: (version 24.3.12.76.altinitystable, build id: F0A1AAE97F8866CCF1D9D2182F3D03DBAC71CBE8, git hash: 2f7ddaa904b1e8b911d6f3d911cf6e53720aba01) (from thread 4401) Terminate called for uncaught exception: 2024.12.16 11:34:43.188495 [ 3116 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:02:31.985720 [ 2754 ] {} BaseDaemon: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/IO/WriteBufferFromFileDecorator.cpp:0: DB::WriteBufferFromFileDecorator::finalizeImpl() @ 0x000000001a358847 21. /build/src/Disks/IO/WriteBufferWithFinalizeCallback.cpp:18: DB::WriteBufferWithFinalizeCallback::finalizeImpl() @ 0x000000001a3585b9 22. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 23. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:1666: DB::IMergeTreeDataPart::appendCSNToVersionMetadata(DB::VersionMetadata::WhichCSN) const @ 0x000000001cac5668 24. /build/src/Interpreters/MergeTreeTransaction.cpp:236: DB::MergeTreeTransaction::afterCommit(unsigned long) @ 0x000000001b64dd56 25. /build/src/Interpreters/TransactionLog.cpp:469: DB::TransactionLog::finalizeCommittedTransaction(DB::MergeTreeTransaction*, unsigned long, BasicScopeGuard>&) @ 0x000000001ba81 2024.12.16 11:34:43.218713 [ 2754 ] {} BaseDaemon: 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/IO/WriteBufferFromFileDecorator.cpp:0: DB::WriteBufferFromFileDecorator::finalizeImpl() @ 0x000000001a358847 21. /build/src/Disks/IO/WriteBufferWithFinalizeCallback.cpp:18: DB::WriteBufferWithFinalizeCallback::finalizeImpl() @ 0x000000001a3585b9 22. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 23. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:1666: DB::IMergeTreeDataPart::appendCSNToVersionMetadata(DB::VersionMetadata::WhichCSN) const @ 0x000000001cac5668 24. /build/src/Interpreters/MergeTreeTransaction.cpp:236: DB::MergeTreeTransaction::afterCommit(unsigned long) @ 0x000000001b64dd56 25. /build/src/Interpreters/TransactionLog.cpp:469: DB::TransactionLog::finalizeCommittedTransaction(DB::MergeTreeTransaction*, unsigned long, BasicScopeGuard>&) @ 0x000000001ba81 2024.12.16 11:34:43.223926 [ 2758 ] {637fcad7-bdd3-4afd-8c08-ff2390f13912} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:53048) (comment: 01083_window_view_select.sh) (in query: SELECT count(*) FROM wv), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 11:34:43.239932 [ 2754 ] {} BaseDaemon: 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/IO/WriteBufferFromFileDecorator.cpp:0: DB::WriteBufferFromFileDecorator::finalizeImpl() @ 0x000000001a358847 21. /build/src/Disks/IO/WriteBufferWithFinalizeCallback.cpp:18: DB::WriteBufferWithFinalizeCallback::finalizeImpl() @ 0x000000001a3585b9 22. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 23. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:1666: DB::IMergeTreeDataPart::appendCSNToVersionMetadata(DB::VersionMetadata::WhichCSN) const @ 0x000000001cac5668 24. /build/src/Interpreters/MergeTreeTransaction.cpp:236: DB::MergeTreeTransaction::afterCommit(unsigned long) @ 0x000000001b64dd56 25. /build/src/Interpreters/TransactionLog.cpp:469: DB::TransactionLog::finalizeCommittedTransaction(DB::MergeTreeTransaction*, unsigned long, BasicScopeGuard>&) @ 0x000000001ba81 2024.12.16 11:34:43.258786 [ 2754 ] {} BaseDaemon: 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/IO/WriteBufferFromFileDecorator.cpp:0: DB::WriteBufferFromFileDecorator::finalizeImpl() @ 0x000000001a358847 21. /build/src/Disks/IO/WriteBufferWithFinalizeCallback.cpp:18: DB::WriteBufferWithFinalizeCallback::finalizeImpl() @ 0x000000001a3585b9 22. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 23. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:1666: DB::IMergeTreeDataPart::appendCSNToVersionMetadata(DB::VersionMetadata::WhichCSN) const @ 0x000000001cac5668 24. /build/src/Interpreters/MergeTreeTransaction.cpp:236: DB::MergeTreeTransaction::afterCommit(unsigned long) @ 0x000000001b64dd56 25. /build/src/Interpreters/TransactionLog.cpp:469: DB::TransactionLog::finalizeCommittedTransaction(DB::MergeTreeTransaction*, unsigned long, BasicScopeGuard>&) @ 0x000000001ba81 2024.12.16 11:34:43.305433 [ 2754 ] {} BaseDaemon: 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/IO/WriteBufferFromFileDecorator.cpp:0: DB::WriteBufferFromFileDecorator::finalizeImpl() @ 0x000000001a358847 21. /build/src/Disks/IO/WriteBufferWithFinalizeCallback.cpp:18: DB::WriteBufferWithFinalizeCallback::finalizeImpl() @ 0x000000001a3585b9 22. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 23. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:1666: DB::IMergeTreeDataPart::appendCSNToVersionMetadata(DB::VersionMetadata::WhichCSN) const @ 0x000000001cac5668 24. /build/src/Interpreters/MergeTreeTransaction.cpp:236: DB::MergeTreeTransaction::afterCommit(unsigned long) @ 0x000000001b64dd56 25. /build/src/Interpreters/TransactionLog.cpp:469: DB::TransactionLog::finalizeCommittedTransaction(DB::MergeTreeTransaction*, unsigned long, BasicScopeGuard>&) @ 0x000000001ba81 2024.12.16 11:34:43.332865 [ 2754 ] {} BaseDaemon: 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/IO/WriteBufferFromFileDecorator.cpp:0: DB::WriteBufferFromFileDecorator::finalizeImpl() @ 0x000000001a358847 21. /build/src/Disks/IO/WriteBufferWithFinalizeCallback.cpp:18: DB::WriteBufferWithFinalizeCallback::finalizeImpl() @ 0x000000001a3585b9 22. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 23. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:1666: DB::IMergeTreeDataPart::appendCSNToVersionMetadata(DB::VersionMetadata::WhichCSN) const @ 0x000000001cac5668 24. /build/src/Interpreters/MergeTreeTransaction.cpp:236: DB::MergeTreeTransaction::afterCommit(unsigned long) @ 0x000000001b64dd56 25. /build/src/Interpreters/TransactionLog.cpp:469: DB::TransactionLog::finalizeCommittedTransaction(DB::MergeTreeTransaction*, unsigned long, BasicScopeGuard>&) @ 0x000000001ba81 2024.12.16 11:34:43.351743 [ 2754 ] {} BaseDaemon: 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/IO/WriteBufferFromFileDecorator.cpp:0: DB::WriteBufferFromFileDecorator::finalizeImpl() @ 0x000000001a358847 21. /build/src/Disks/IO/WriteBufferWithFinalizeCallback.cpp:18: DB::WriteBufferWithFinalizeCallback::finalizeImpl() @ 0x000000001a3585b9 22. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 23. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:1666: DB::IMergeTreeDataPart::appendCSNToVersionMetadata(DB::VersionMetadata::WhichCSN) const @ 0x000000001cac5668 24. /build/src/Interpreters/MergeTreeTransaction.cpp:236: DB::MergeTreeTransaction::afterCommit(unsigned long) @ 0x000000001b64dd56 25. /build/src/Interpreters/TransactionLog.cpp:469: DB::TransactionLog::finalizeCommittedTransaction(DB::MergeTreeTransaction*, unsigned long, BasicScopeGuard>&) @ 0x000000001ba81 2024.12.16 11:34:43.368580 [ 2754 ] {} BaseDaemon: 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/IO/WriteBufferFromFileDecorator.cpp:0: DB::WriteBufferFromFileDecorator::finalizeImpl() @ 0x000000001a358847 21. /build/src/Disks/IO/WriteBufferWithFinalizeCallback.cpp:18: DB::WriteBufferWithFinalizeCallback::finalizeImpl() @ 0x000000001a3585b9 22. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 23. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:1666: DB::IMergeTreeDataPart::appendCSNToVersionMetadata(DB::VersionMetadata::WhichCSN) const @ 0x000000001cac5668 24. /build/src/Interpreters/MergeTreeTransaction.cpp:236: DB::MergeTreeTransaction::afterCommit(unsigned long) @ 0x000000001b64dd56 25. /build/src/Interpreters/TransactionLog.cpp:469: DB::TransactionLog::finalizeCommittedTransaction(DB::MergeTreeTransaction*, unsigned long, BasicScopeGuard>&) @ 0x000000001ba81 2024.12.16 11:34:43.377279 [ 2754 ] {} BaseDaemon: 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/IO/WriteBufferFromFileDecorator.cpp:0: DB::WriteBufferFromFileDecorator::finalizeImpl() @ 0x000000001a358847 21. /build/src/Disks/IO/WriteBufferWithFinalizeCallback.cpp:18: DB::WriteBufferWithFinalizeCallback::finalizeImpl() @ 0x000000001a3585b9 22. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 23. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:1666: DB::IMergeTreeDataPart::appendCSNToVersionMetadata(DB::VersionMetadata::WhichCSN) const @ 0x000000001cac5668 24. /build/src/Interpreters/MergeTreeTransaction.cpp:236: DB::MergeTreeTransaction::afterCommit(unsigned long) @ 0x000000001b64dd56 25. /build/src/Interpreters/TransactionLog.cpp:469: DB::TransactionLog::finalizeCommittedTransaction(DB::MergeTreeTransaction*, unsigned long, BasicScopeGuard>&) @ 0x000000001ba81 2024.12.16 11:34:43.388333 [ 2754 ] {} BaseDaemon: 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/IO/WriteBufferFromFileDecorator.cpp:0: DB::WriteBufferFromFileDecorator::finalizeImpl() @ 0x000000001a358847 21. /build/src/Disks/IO/WriteBufferWithFinalizeCallback.cpp:18: DB::WriteBufferWithFinalizeCallback::finalizeImpl() @ 0x000000001a3585b9 22. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 23. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:1666: DB::IMergeTreeDataPart::appendCSNToVersionMetadata(DB::VersionMetadata::WhichCSN) const @ 0x000000001cac5668 24. /build/src/Interpreters/MergeTreeTransaction.cpp:236: DB::MergeTreeTransaction::afterCommit(unsigned long) @ 0x000000001b64dd56 25. /build/src/Interpreters/TransactionLog.cpp:469: DB::TransactionLog::finalizeCommittedTransaction(DB::MergeTreeTransaction*, unsigned long, BasicScopeGuard>&) @ 0x000000001ba81 2024.12.16 11:34:43.405896 [ 2754 ] {} BaseDaemon: 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/IO/WriteBufferFromFileDecorator.cpp:0: DB::WriteBufferFromFileDecorator::finalizeImpl() @ 0x000000001a358847 21. /build/src/Disks/IO/WriteBufferWithFinalizeCallback.cpp:18: DB::WriteBufferWithFinalizeCallback::finalizeImpl() @ 0x000000001a3585b9 22. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 23. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:1666: DB::IMergeTreeDataPart::appendCSNToVersionMetadata(DB::VersionMetadata::WhichCSN) const @ 0x000000001cac5668 24. /build/src/Interpreters/MergeTreeTransaction.cpp:236: DB::MergeTreeTransaction::afterCommit(unsigned long) @ 0x000000001b64dd56 25. /build/src/Interpreters/TransactionLog.cpp:469: DB::TransactionLog::finalizeCommittedTransaction(DB::MergeTreeTransaction*, unsigned long, BasicScopeGuard>&) @ 0x000000001ba81 2024.12.16 11:34:43.409222 [ 2754 ] {} BaseDaemon: 9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority) @ 0x00000000198cb0b6 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/IO/WriteBufferFromFileDecorator.cpp:0: DB::WriteBufferFromFileDecorator::finalizeImpl() @ 0x000000001a358847 21. /build/src/Disks/IO/WriteBufferWithFinalizeCallback.cpp:18: DB::WriteBufferWithFinalizeCallback::finalizeImpl() @ 0x000000001a3585b9 22. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 23. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:1666: DB::IMergeTreeDataPart::appendCSNToVersionMetadata(DB::VersionMetadata::WhichCSN) const @ 0x000000001cac5668 24. /build/src/Interpreters/MergeTreeTransaction.cpp:236: DB::MergeTreeTransaction::afterCommit(unsigned long) @ 0x000000001b64dd56 25. /build/src/Interpreters/TransactionLog.cpp:469: DB::TransactionLog::finalizeCommittedTransaction(DB::MergeTreeTransaction*, unsigned long, BasicScopeGuard>&) @ 0x000000001ba81 2024.12.16 11:34:43.421801 [ 2754 ] {} BaseDaemon: 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198caf5b 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/IO/WriteBufferFromFileDecorator.cpp:0: DB::WriteBufferFromFileDecorator::finalizeImpl() @ 0x000000001a358847 21. /build/src/Disks/IO/WriteBufferWithFinalizeCallback.cpp:18: DB::WriteBufferWithFinalizeCallback::finalizeImpl() @ 0x000000001a3585b9 22. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 23. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:1666: DB::IMergeTreeDataPart::appendCSNToVersionMetadata(DB::VersionMetadata::WhichCSN) const @ 0x000000001cac5668 24. /build/src/Interpreters/MergeTreeTransaction.cpp:236: DB::MergeTreeTransaction::afterCommit(unsigned long) @ 0x000000001b64dd56 25. /build/src/Interpreters/TransactionLog.cpp:469: DB::TransactionLog::finalizeCommittedTransaction(DB::MergeTreeTransaction*, unsigned long, BasicScopeGuard>&) @ 0x000000001ba81 2024.12.16 11:34:43.439486 [ 2754 ] {} BaseDaemon: 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198caf10 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/IO/WriteBufferFromFileDecorator.cpp:0: DB::WriteBufferFromFileDecorator::finalizeImpl() @ 0x000000001a358847 21. /build/src/Disks/IO/WriteBufferWithFinalizeCallback.cpp:18: DB::WriteBufferWithFinalizeCallback::finalizeImpl() @ 0x000000001a3585b9 22. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 23. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:1666: DB::IMergeTreeDataPart::appendCSNToVersionMetadata(DB::VersionMetadata::WhichCSN) const @ 0x000000001cac5668 24. /build/src/Interpreters/MergeTreeTransaction.cpp:236: DB::MergeTreeTransaction::afterCommit(unsigned long) @ 0x000000001b64dd56 25. /build/src/Interpreters/TransactionLog.cpp:469: DB::TransactionLog::finalizeCommittedTransaction(DB::MergeTreeTransaction*, unsigned long, BasicScopeGuard>&) @ 0x000000001ba81 2024.12.16 11:34:43.483195 [ 2754 ] {} BaseDaemon: 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198caed0 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/IO/WriteBufferFromFileDecorator.cpp:0: DB::WriteBufferFromFileDecorator::finalizeImpl() @ 0x000000001a358847 21. /build/src/Disks/IO/WriteBufferWithFinalizeCallback.cpp:18: DB::WriteBufferWithFinalizeCallback::finalizeImpl() @ 0x000000001a3585b9 22. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 23. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:1666: DB::IMergeTreeDataPart::appendCSNToVersionMetadata(DB::VersionMetadata::WhichCSN) const @ 0x000000001cac5668 24. /build/src/Interpreters/MergeTreeTransaction.cpp:236: DB::MergeTreeTransaction::afterCommit(unsigned long) @ 0x000000001b64dd56 25. /build/src/Interpreters/TransactionLog.cpp:469: DB::TransactionLog::finalizeCommittedTransaction(DB::MergeTreeTransaction*, unsigned long, BasicScopeGuard>&) @ 0x000000001ba81 2024.12.16 11:34:43.497993 [ 2754 ] {} BaseDaemon: 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198cae7b 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/IO/WriteBufferFromFileDecorator.cpp:0: DB::WriteBufferFromFileDecorator::finalizeImpl() @ 0x000000001a358847 21. /build/src/Disks/IO/WriteBufferWithFinalizeCallback.cpp:18: DB::WriteBufferWithFinalizeCallback::finalizeImpl() @ 0x000000001a3585b9 22. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 23. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:1666: DB::IMergeTreeDataPart::appendCSNToVersionMetadata(DB::VersionMetadata::WhichCSN) const @ 0x000000001cac5668 24. /build/src/Interpreters/MergeTreeTransaction.cpp:236: DB::MergeTreeTransaction::afterCommit(unsigned long) @ 0x000000001b64dd56 25. /build/src/Interpreters/TransactionLog.cpp:469: DB::TransactionLog::finalizeCommittedTransaction(DB::MergeTreeTransaction*, unsigned long, BasicScopeGuard>&) @ 0x000000001ba81 2024.12.16 11:34:43.521235 [ 2754 ] {} BaseDaemon: 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013397851 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/IO/WriteBufferFromFileDecorator.cpp:0: DB::WriteBufferFromFileDecorator::finalizeImpl() @ 0x000000001a358847 21. /build/src/Disks/IO/WriteBufferWithFinalizeCallback.cpp:18: DB::WriteBufferWithFinalizeCallback::finalizeImpl() @ 0x000000001a3585b9 22. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 23. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:1666: DB::IMergeTreeDataPart::appendCSNToVersionMetadata(DB::VersionMetadata::WhichCSN) const @ 0x000000001cac5668 24. /build/src/Interpreters/MergeTreeTransaction.cpp:236: DB::MergeTreeTransaction::afterCommit(unsigned long) @ 0x000000001b64dd56 25. /build/src/Interpreters/TransactionLog.cpp:469: DB::TransactionLog::finalizeCommittedTransaction(DB::MergeTreeTransaction*, unsigned long, BasicScopeGuard>&) @ 0x000000001ba81 2024.12.16 11:34:43.560617 [ 2754 ] {} BaseDaemon: 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013392f70 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/IO/WriteBufferFromFileDecorator.cpp:0: DB::WriteBufferFromFileDecorator::finalizeImpl() @ 0x000000001a358847 21. /build/src/Disks/IO/WriteBufferWithFinalizeCallback.cpp:18: DB::WriteBufferWithFinalizeCallback::finalizeImpl() @ 0x000000001a3585b9 22. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 23. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:1666: DB::IMergeTreeDataPart::appendCSNToVersionMetadata(DB::VersionMetadata::WhichCSN) const @ 0x000000001cac5668 24. /build/src/Interpreters/MergeTreeTransaction.cpp:236: DB::MergeTreeTransaction::afterCommit(unsigned long) @ 0x000000001b64dd56 25. /build/src/Interpreters/TransactionLog.cpp:469: DB::TransactionLog::finalizeCommittedTransaction(DB::MergeTreeTransaction*, unsigned long, BasicScopeGuard>&) @ 0x000000001ba81 2024.12.16 11:34:43.586221 [ 2754 ] {} BaseDaemon: 16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function&&) @ 0x0000000019371943 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/IO/WriteBufferFromFileDecorator.cpp:0: DB::WriteBufferFromFileDecorator::finalizeImpl() @ 0x000000001a358847 21. /build/src/Disks/IO/WriteBufferWithFinalizeCallback.cpp:18: DB::WriteBufferWithFinalizeCallback::finalizeImpl() @ 0x000000001a3585b9 22. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 23. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:1666: DB::IMergeTreeDataPart::appendCSNToVersionMetadata(DB::VersionMetadata::WhichCSN) const @ 0x000000001cac5668 24. /build/src/Interpreters/MergeTreeTransaction.cpp:236: DB::MergeTreeTransaction::afterCommit(unsigned long) @ 0x000000001b64dd56 25. /build/src/Interpreters/TransactionLog.cpp:469: DB::TransactionLog::finalizeCommittedTransaction(DB::MergeTreeTransaction*, unsigned long, BasicScopeGuard>&) @ 0x000000001ba81 2024.12.16 11:34:43.634972 [ 2754 ] {} BaseDaemon: 17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199099ab 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/IO/WriteBufferFromFileDecorator.cpp:0: DB::WriteBufferFromFileDecorator::finalizeImpl() @ 0x000000001a358847 21. /build/src/Disks/IO/WriteBufferWithFinalizeCallback.cpp:18: DB::WriteBufferWithFinalizeCallback::finalizeImpl() @ 0x000000001a3585b9 22. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 23. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:1666: DB::IMergeTreeDataPart::appendCSNToVersionMetadata(DB::VersionMetadata::WhichCSN) const @ 0x000000001cac5668 24. /build/src/Interpreters/MergeTreeTransaction.cpp:236: DB::MergeTreeTransaction::afterCommit(unsigned long) @ 0x000000001b64dd56 25. /build/src/Interpreters/TransactionLog.cpp:469: DB::TransactionLog::finalizeCommittedTransaction(DB::MergeTreeTransaction*, unsigned long, BasicScopeGuard>&) @ 0x000000001ba81 2024.12.16 11:34:43.648510 [ 2754 ] {} BaseDaemon: 18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x000000001990910f 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/IO/WriteBufferFromFileDecorator.cpp:0: DB::WriteBufferFromFileDecorator::finalizeImpl() @ 0x000000001a358847 21. /build/src/Disks/IO/WriteBufferWithFinalizeCallback.cpp:18: DB::WriteBufferWithFinalizeCallback::finalizeImpl() @ 0x000000001a3585b9 22. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 23. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:1666: DB::IMergeTreeDataPart::appendCSNToVersionMetadata(DB::VersionMetadata::WhichCSN) const @ 0x000000001cac5668 24. /build/src/Interpreters/MergeTreeTransaction.cpp:236: DB::MergeTreeTransaction::afterCommit(unsigned long) @ 0x000000001b64dd56 25. /build/src/Interpreters/TransactionLog.cpp:469: DB::TransactionLog::finalizeCommittedTransaction(DB::MergeTreeTransaction*, unsigned long, BasicScopeGuard>&) @ 0x000000001ba81 2024.12.16 11:34:43.685353 [ 2754 ] {} BaseDaemon: 19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35891e 20. /build/src/IO/WriteBufferFromFileDecorator.cpp:0: DB::WriteBufferFromFileDecorator::finalizeImpl() @ 0x000000001a358847 21. /build/src/Disks/IO/WriteBufferWithFinalizeCallback.cpp:18: DB::WriteBufferWithFinalizeCallback::finalizeImpl() @ 0x000000001a3585b9 22. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 23. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:1666: DB::IMergeTreeDataPart::appendCSNToVersionMetadata(DB::VersionMetadata::WhichCSN) const @ 0x000000001cac5668 24. /build/src/Interpreters/MergeTreeTransaction.cpp:236: DB::MergeTreeTransaction::afterCommit(unsigned long) @ 0x000000001b64dd56 25. /build/src/Interpreters/TransactionLog.cpp:469: DB::TransactionLog::finalizeCommittedTransaction(DB::MergeTreeTransaction*, unsigned long, BasicScopeGuard>&) @ 0x000000001ba81 2024.12.16 11:34:43.747401 [ 2754 ] {} BaseDaemon: 20. /build/src/IO/WriteBufferFromFileDecorator.cpp:0: DB::WriteBufferFromFileDecorator::finalizeImpl() @ 0x000000001a358847 21. /build/src/Disks/IO/WriteBufferWithFinalizeCallback.cpp:18: DB::WriteBufferWithFinalizeCallback::finalizeImpl() @ 0x000000001a3585b9 22. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 23. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:1666: DB::IMergeTreeDataPart::appendCSNToVersionMetadata(DB::VersionMetadata::WhichCSN) const @ 0x000000001cac5668 24. /build/src/Interpreters/MergeTreeTransaction.cpp:236: DB::MergeTreeTransaction::afterCommit(unsigned long) @ 0x000000001b64dd56 25. /build/src/Interpreters/TransactionLog.cpp:469: DB::TransactionLog::finalizeCommittedTransaction(DB::MergeTreeTransaction*, unsigned long, BasicScopeGuard>&) @ 0x000000001ba81 2024.12.16 11:34:43.769152 [ 2754 ] {} BaseDaemon: 21. /build/src/Disks/IO/WriteBufferWithFinalizeCallback.cpp:18: DB::WriteBufferWithFinalizeCallback::finalizeImpl() @ 0x000000001a3585b9 22. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 23. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:1666: DB::IMergeTreeDataPart::appendCSNToVersionMetadata(DB::VersionMetadata::WhichCSN) const @ 0x000000001cac5668 24. /build/src/Interpreters/MergeTreeTransaction.cpp:236: DB::MergeTreeTransaction::afterCommit(unsigned long) @ 0x000000001b64dd56 25. /build/src/Interpreters/TransactionLog.cpp:469: DB::TransactionLog::finalizeCommittedTransaction(DB::MergeTreeTransaction*, unsigned long, BasicScopeGuard>&) @ 0x000000001ba81 2024.12.16 11:34:43.784093 [ 2754 ] {} BaseDaemon: 22. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 23. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:1666: DB::IMergeTreeDataPart::appendCSNToVersionMetadata(DB::VersionMetadata::WhichCSN) const @ 0x000000001cac5668 24. /build/src/Interpreters/MergeTreeTransaction.cpp:236: DB::MergeTreeTransaction::afterCommit(unsigned long) @ 0x000000001b64dd56 25. /build/src/Interpreters/TransactionLog.cpp:469: DB::TransactionLog::finalizeCommittedTransaction(DB::MergeTreeTransaction*, unsigned long, BasicScopeGuard>&) @ 0x000000001ba81 2024.12.16 11:34:43.792616 [ 2758 ] {637fcad7-bdd3-4afd-8c08-ff2390f13912} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133dca68 6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e1a2d 7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x00000000133d6c18 8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl>::scheduleOrThrowOnError(std::function, Priority) @ 0x00000000133d6a9c 9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d516d07 10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514e45 11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr, unsigned long, bool) @ 0x000000001d539d70 13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d539bdf 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539b55 15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d539b39 16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d539a9d 17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5399a7 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d539915 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5398f5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5398d5 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5398a0 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 29. ? @ 0x00007f713a222ac3 30. ? @ 0x00007f713a2b4850 2024.12.16 11:34:43.808258 [ 2754 ] {} BaseDaemon: 23. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:1666: DB::IMergeTreeDataPart::appendCSNToVersionMetadata(DB::VersionMetadata::WhichCSN) const @ 0x000000001cac5668 24. /build/src/Interpreters/MergeTreeTransaction.cpp:236: DB::MergeTreeTransaction::afterCommit(unsigned long) @ 0x000000001b64dd56 25. /build/src/Interpreters/TransactionLog.cpp:469: DB::TransactionLog::finalizeCommittedTransaction(DB::MergeTreeTransaction*, unsigned long, BasicScopeGuard>&) @ 0x000000001ba81 2024.12.16 11:34:43.830955 [ 3855 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a09d07 4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0de47 5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022894827 6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a416b 7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x00000000228a2b09 8. /build/base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::peerAddress() @ 0x00000000228a6a1e 9. /build/base/poco/Net/include/Poco/Net/Socket.h:596: Poco::Net::Socket::peerAddress() const @ 0x00000000133cec28 10. /build/base/poco/Net/src/HTTPServerSession.cpp:65: Poco::Net::HTTPServerSession::clientAddress() @ 0x00000000228831b0 11. /build/src/Server/HTTP/HTTPServerRequest.cpp:34: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&, StrongTypedef const&) @ 0x000000001d4968f9 12. /build/src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x000000001d49595c 13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 18. ? @ 0x00007f713a222ac3 19. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:43.835151 [ 2754 ] {} BaseDaemon: 24. /build/src/Interpreters/MergeTreeTransaction.cpp:236: DB::MergeTreeTransaction::afterCommit(unsigned long) @ 0x000000001b64dd56 25. /build/src/Interpreters/TransactionLog.cpp:469: DB::TransactionLog::finalizeCommittedTransaction(DB::MergeTreeTransaction*, unsigned long, BasicScopeGuard>&) @ 0x000000001ba81 2024.12.16 11:34:43.851787 [ 2754 ] {} BaseDaemon: 25. /build/src/Interpreters/TransactionLog.cpp:469: DB::TransactionLog::finalizeCommittedTransaction(DB::MergeTreeTransaction*, unsigned long, BasicScopeGuard>&) @ 0x000000001ba81 2024.12.16 11:34:43.922499 [ 8528 ] {} BaseDaemon: ########## Short fault info ############ 2024.12.16 11:34:43.924004 [ 8528 ] {} BaseDaemon: (version 24.3.12.76.altinitystable, build id: F0A1AAE97F8866CCF1D9D2182F3D03DBAC71CBE8, git hash: 2f7ddaa904b1e8b911d6f3d911cf6e53720aba01) (from thread 4401) Received signal 6 2024.12.16 11:34:43.932574 [ 8528 ] {} BaseDaemon: Signal description: Aborted 2024.12.16 11:34:43.934406 [ 8528 ] {} BaseDaemon: 2024.12.16 11:34:43.938441 [ 8528 ] {} BaseDaemon: Stack trace: 0x000000001330f64a 0x000000001330f540 0x0000000013724f25 0x00007f713a1d0520 0x00007f713a2249fd 0x00007f713a1d0476 0x00007f713a1b67f3 0x00000000137245b0 0x00000000261721d2 0x0000000026172106 0x000000000a8e1efe 0x000000001b64df68 0x000000001ba812d1 0x000000001ba85bf8 0x000000001bbc50a9 0x000000001bbc4a5d 0x000000001bbba3cb 0x000000001bbbadf1 0x000000001bbbacdd 0x000000001bbbac9d 0x000000001bbbac5d 0x000000001bbbac28 0x0000000019e3ae5e 0x0000000019e3a9bd 0x0000000019e3a584 0x000000001d47ab3c 0x000000001d46ff42 0x000000001d4870c5 0x00000000228aead9 0x00000000228af328 0x0000000022a86654 0x0000000022a833fa 0x0000000022a8213e 0x00007f713a222ac3 0x00007f713a2b4850 2024.12.16 11:34:43.947025 [ 8528 ] {} BaseDaemon: ######################################## 2024.12.16 11:34:43.987376 [ 8528 ] {} BaseDaemon: (version 24.3.12.76.altinitystable, build id: F0A1AAE97F8866CCF1D9D2182F3D03DBAC71CBE8, git hash: 2f7ddaa904b1e8b911d6f3d911cf6e53720aba01) (from thread 4401) (query_id: 9855f21f-bee9-4008-88b9-e2bf76d13053) (query: INSERT INTO report(id,event_date,priority,description) VALUES ) Received signal Aborted (6) 2024.12.16 11:34:43.998777 [ 8528 ] {} BaseDaemon: 2024.12.16 11:34:44.009510 [ 8528 ] {} BaseDaemon: Stack trace: 0x000000001330f64a 0x000000001330f540 0x0000000013724f25 0x00007f713a1d0520 0x00007f713a2249fd 0x00007f713a1d0476 0x00007f713a1b67f3 0x00000000137245b0 0x00000000261721d2 0x0000000026172106 0x000000000a8e1efe 0x000000001b64df68 0x000000001ba812d1 0x000000001ba85bf8 0x000000001bbc50a9 0x000000001bbc4a5d 0x000000001bbba3cb 0x000000001bbbadf1 0x000000001bbbacdd 0x000000001bbbac9d 0x000000001bbbac5d 0x000000001bbbac28 0x0000000019e3ae5e 0x0000000019e3a9bd 0x0000000019e3a584 0x000000001d47ab3c 0x000000001d46ff42 0x000000001d4870c5 0x00000000228aead9 0x00000000228af328 0x0000000022a86654 0x0000000022a833fa 0x0000000022a8213e 0x00007f713a222ac3 0x00007f713a2b4850 2024.12.16 11:34:44.332803 [ 8528 ] {} BaseDaemon: 0. /build/src/Common/StackTrace.cpp:349: StackTrace::tryCapture() @ 0x000000001330f64a 2024.12.16 11:34:44.463169 [ 3295 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:44.482449 [ 3620 ] {} ZooKeeperClient: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:48268 -> [::1]:9181). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:169: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000134e8a44 7. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 8. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:303: Coordination::ZooKeeper::flushWriteBuffer() @ 0x000000001e23d7fd 9. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:707: Coordination::ZooKeeper::sendThread() @ 0x000000001e246469 10. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:397: Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_0::operator()() const @ 0x000000001e24ce58 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001e24ce35 12. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_0&, std::tuple<>&>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e24ce19 13. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_0&, std::tuple<>&>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_0&, std::tuple<>&) @ 0x000000001e24cd7d 14. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_0>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_0&&)::'lambda'()::operator()() @ 0x000000001e24cca5 15. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001e24cc15 16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001e24cbf5 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001e24cbd5 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001e24cba0 19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 21. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 22. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 24. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 25. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 26. ? @ 0x00007f713a222ac3 27. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:44.487423 [ 3723 ] {} ZooKeeperClient: Code: 33. DB::Exception: Cannot read all data. Bytes read: 0. Bytes expected: 4. (CANNOT_READ_ALL_DATA), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, unsigned long&, String&&) @ 0x000000000afd304c 6. /build/src/IO/ReadBuffer.h:199: DB::ReadBuffer::readStrict(char*, unsigned long) @ 0x000000000afd2e6f 7. /build/src/IO/ReadHelpers.h:118: void DB::readPODBinary(int&, DB::ReadBuffer&) @ 0x00000000133868e2 8. /build/src/IO/ReadHelpers.h:1303: void DB::readBinary(int&, DB::ReadBuffer&) @ 0x000000001338689d 9. /build/src/IO/ReadHelpers.h:1340: void DB::readBinaryEndian<(std::endian)64206, int>(int&, DB::ReadBuffer&) @ 0x000000001d41cd3d 10. /build/src/IO/ReadHelpers.h:1353: void DB::readBinaryBigEndian(int&, DB::ReadBuffer&) @ 0x000000001d41ccfd 11. /build/src/Common/ZooKeeper/ZooKeeperIO.h:51: void Coordination::read(int&, DB::ReadBuffer&) @ 0x000000001d41743d 12. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:289: void Coordination::ZooKeeper::read(int&) @ 0x000000001e2523ed 13. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:807: Coordination::ZooKeeper::receiveEvent() @ 0x000000001e24778c 14. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:773: Coordination::ZooKeeper::receiveThread() @ 0x000000001e2471d9 15. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:398: Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_1::operator()() const @ 0x000000001e24d698 16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001e24d675 17. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_1&, std::tuple<>&>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_1&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e24d659 18. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_1&, std::tuple<>&>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_1&, std::tuple<>&) @ 0x000000001e24d5bd 19. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_1>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_1&&)::'lambda'()::operator()() @ 0x000000001e24d4e5 20. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001e24d455 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001e24d435 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001e24d415 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001e24d3e0 24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 26. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 27. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 29. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 30. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 31. ? @ 0x00007f713a222ac3 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:44.679528 [ 2758 ] {637fcad7-bdd3-4afd-8c08-ff2390f13912} TCPHandler: Client has gone away. 2024.12.16 11:34:44.690488 [ 4182 ] {9c0cf181-2953-4869-9670-d68809ed0e20} executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:9000 -> [::1]:53020). (NETWORK_ERROR) (version 24.3.12.76.altinitystable) (from [::1]:53020) (comment: 03145_non_loaded_projection_backup.sh) (in query: insert into tp_1 select number, number from numbers(3);), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:169: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000134e8a44 7. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 8. /build/src/Server/TCPHandler.cpp:1246: DB::TCPHandler::sendProfileEvents() @ 0x000000001d4802b9 9. /build/src/Server/TCPHandler.cpp:1256: DB::TCPHandler::sendSelectProfileEvents() @ 0x000000001d47b3f4 10. /build/src/Server/TCPHandler.cpp:579: DB::TCPHandler::runImpl() @ 0x000000001d470211 11. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 12. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 13. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 14. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 15. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 16. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 17. ? @ 0x00007f713a222ac3 18. ? @ 0x00007f713a2b4850 2024.12.16 11:34:44.729738 [ 8528 ] {} BaseDaemon: 1. /build/src/Common/StackTrace.cpp:323: StackTrace::StackTrace(ucontext_t const&) @ 0x000000001330f540 2024.12.16 11:34:44.830909 [ 5023 ] {368997f9-8222-4111-88b8-a54e068586ee} DynamicQueryHandler: Cannot flush data to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:49344). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:184: DB::WriteBufferFromHTTPServerResponse::finalizeImpl() @ 0x000000001d49e9d2 11. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 12. /build/src/Server/HTTPHandler.h:94: DB::HTTPHandler::Output::finalize() @ 0x000000001d3ea829 13. /build/src/Server/HTTPHandler.cpp:910: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da5ca 14. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:44.840593 [ 5021 ] {971ceec6-cc48-4e57-a8d0-3101ca85f355} DynamicQueryHandler: Cannot flush data to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:60462). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:184: DB::WriteBufferFromHTTPServerResponse::finalizeImpl() @ 0x000000001d49e9d2 11. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 12. /build/src/Server/HTTPHandler.h:94: DB::HTTPHandler::Output::finalize() @ 0x000000001d3ea829 13. /build/src/Server/HTTPHandler.cpp:910: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da5ca 14. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:44.849814 [ 8529 ] {fc9df9c0-3f2d-4f07-b453-3895c0855d27} DynamicQueryHandler: Cannot flush data to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:59906). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:184: DB::WriteBufferFromHTTPServerResponse::finalizeImpl() @ 0x000000001d49e9d2 11. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 12. /build/src/Server/HTTPHandler.h:94: DB::HTTPHandler::Output::finalize() @ 0x000000001d3ea829 13. /build/src/Server/HTTPHandler.cpp:910: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da5ca 14. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:44.849861 [ 8532 ] {53f9d529-d853-4369-8677-d1108da2a035} DynamicQueryHandler: Cannot flush data to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:41922). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:184: DB::WriteBufferFromHTTPServerResponse::finalizeImpl() @ 0x000000001d49e9d2 11. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 12. /build/src/Server/HTTPHandler.h:94: DB::HTTPHandler::Output::finalize() @ 0x000000001d3ea829 13. /build/src/Server/HTTPHandler.cpp:910: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da5ca 14. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:45.139748 [ 3620 ] {} ZooKeeperClient: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a09d07 4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0de47 5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022894827 6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a416b 7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x00000000228a2b09 8. /build/base/poco/Net/src/SocketImpl.cpp:272: Poco::Net::SocketImpl::shutdown() @ 0x00000000228a5532 9. /build/base/poco/Net/src/StreamSocket.cpp:109: Poco::Net::StreamSocket::shutdown() @ 0x00000000228a925e 10. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:1032: Coordination::ZooKeeper::finalize(bool, bool, String const&) @ 0x000000001e23e4e9 11. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:733: Coordination::ZooKeeper::sendThread() @ 0x000000001e246699 12. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:397: Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_0::operator()() const @ 0x000000001e24ce58 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001e24ce35 14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_0&, std::tuple<>&>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e24ce19 15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_0&, std::tuple<>&>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_0&, std::tuple<>&) @ 0x000000001e24cd7d 16. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_0>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_0&&)::'lambda'()::operator()() @ 0x000000001e24cca5 17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001e24cc15 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001e24cbf5 19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001e24cbd5 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001e24cba0 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 23. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 24. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 28. ? @ 0x00007f713a222ac3 29. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:45.200131 [ 8528 ] {} BaseDaemon: 2. /build/src/Daemon/BaseDaemon.cpp:151: signalHandler(int, siginfo_t*, void*) @ 0x0000000013724f25 2024.12.16 11:34:45.228655 [ 8528 ] {} BaseDaemon: 3. ? @ 0x00007f713a1d0520 2024.12.16 11:34:45.295784 [ 8528 ] {} BaseDaemon: 4. ? @ 0x00007f713a2249fd 2024.12.16 11:34:45.311418 [ 8528 ] {} BaseDaemon: 5. ? @ 0x00007f713a1d0476 2024.12.16 11:34:45.368501 [ 8528 ] {} BaseDaemon: 6. ? @ 0x00007f713a1b67f3 2024.12.16 11:34:45.396353 [ 8533 ] {0932cc5a-6626-41d0-b078-4dc1ec80c863} executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:48132): While executing TabSeparatedRowOutputFormat. (NETWORK_ERROR) (version 24.3.12.76.altinitystable) (from [::1]:48132) (in query: EXISTS TABLE test.hits ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Processors/Formats/IOutputFormat.cpp:111: DB::IOutputFormat::flush() @ 0x000000001d547b9c 13. /build/src/Processors/Formats/IOutputFormat.cpp:0: DB::IOutputFormat::work() @ 0x000000001d5478f4 14. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 15. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 16. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 17. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 18. /build/src/Processors/Executors/PipelineExecutor.cpp:411: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514ed5 19. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 20. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 21. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 22. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 23. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 24. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 25. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 26. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 27. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 28. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 29. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 30. ? @ 0x00007f713a222ac3 31. ? @ 0x00007f713a2b4850 2024.12.16 11:34:45.395924 [ 8508 ] {e908df23-54cf-4935-857b-2e4d9e700835} executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:59176): While executing TabSeparatedRowOutputFormat. (NETWORK_ERROR) (version 24.3.12.76.altinitystable) (from [::1]:59176) (in query: EXISTS TABLE test.hits ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Processors/Formats/IOutputFormat.cpp:111: DB::IOutputFormat::flush() @ 0x000000001d547b9c 13. /build/src/Processors/Formats/IOutputFormat.cpp:0: DB::IOutputFormat::work() @ 0x000000001d5478f4 14. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 15. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 16. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 17. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 18. /build/src/Processors/Executors/PipelineExecutor.cpp:411: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514ed5 19. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 20. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 21. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 22. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 23. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 24. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 25. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 26. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 27. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 28. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 29. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 30. ? @ 0x00007f713a222ac3 31. ? @ 0x00007f713a2b4850 2024.12.16 11:34:45.401534 [ 8544 ] {4a8e9f14-c4f0-4a9f-b727-1bef9208abe9} executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:54992): While executing TabSeparatedRowOutputFormat. (NETWORK_ERROR) (version 24.3.12.76.altinitystable) (from [::1]:54992) (in query: EXISTS TABLE test.hits ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Processors/Formats/IOutputFormat.cpp:111: DB::IOutputFormat::flush() @ 0x000000001d547b9c 13. /build/src/Processors/Formats/IOutputFormat.cpp:0: DB::IOutputFormat::work() @ 0x000000001d5478f4 14. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 15. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 16. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 17. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 18. /build/src/Processors/Executors/PipelineExecutor.cpp:411: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514ed5 19. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 20. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 21. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 22. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 23. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 24. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 25. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 26. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 27. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 28. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 29. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 30. ? @ 0x00007f713a222ac3 31. ? @ 0x00007f713a2b4850 2024.12.16 11:34:45.401947 [ 8543 ] {bc6e40fb-6d11-4b3e-b5ca-f58afe01a76d} executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:54990): While executing TabSeparatedRowOutputFormat. (NETWORK_ERROR) (version 24.3.12.76.altinitystable) (from [::1]:54990) (in query: EXISTS TABLE test.hits ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Processors/Formats/IOutputFormat.cpp:111: DB::IOutputFormat::flush() @ 0x000000001d547b9c 13. /build/src/Processors/Formats/IOutputFormat.cpp:0: DB::IOutputFormat::work() @ 0x000000001d5478f4 14. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 15. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 16. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 17. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 18. /build/src/Processors/Executors/PipelineExecutor.cpp:411: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514ed5 19. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 20. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 21. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 22. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 23. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 24. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 25. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 26. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 27. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 28. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 29. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 30. ? @ 0x00007f713a222ac3 31. ? @ 0x00007f713a2b4850 2024.12.16 11:34:45.401948 [ 8542 ] {905fa144-d6d3-4c2b-800d-5fab79b50083} executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:35666): While executing TabSeparatedRowOutputFormat. (NETWORK_ERROR) (version 24.3.12.76.altinitystable) (from [::1]:35666) (in query: EXISTS TABLE test.hits ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Processors/Formats/IOutputFormat.cpp:111: DB::IOutputFormat::flush() @ 0x000000001d547b9c 13. /build/src/Processors/Formats/IOutputFormat.cpp:0: DB::IOutputFormat::work() @ 0x000000001d5478f4 14. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 15. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 16. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 17. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 18. /build/src/Processors/Executors/PipelineExecutor.cpp:411: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514ed5 19. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 20. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 21. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 22. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 23. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 24. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 25. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 26. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 27. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 28. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 29. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 30. ? @ 0x00007f713a222ac3 31. ? @ 0x00007f713a2b4850 2024.12.16 11:34:45.401564 [ 8510 ] {42a22cd2-296e-4347-83d2-1acbf5e30df5} executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:40850): While executing TabSeparatedRowOutputFormat. (NETWORK_ERROR) (version 24.3.12.76.altinitystable) (from [::1]:40850) (in query: EXISTS TABLE test.hits ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Processors/Formats/IOutputFormat.cpp:111: DB::IOutputFormat::flush() @ 0x000000001d547b9c 13. /build/src/Processors/Formats/IOutputFormat.cpp:0: DB::IOutputFormat::work() @ 0x000000001d5478f4 14. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 15. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 16. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 17. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 18. /build/src/Processors/Executors/PipelineExecutor.cpp:411: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514ed5 19. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 20. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 21. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 22. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 23. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 24. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 25. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 26. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 27. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 28. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 29. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 30. ? @ 0x00007f713a222ac3 31. ? @ 0x00007f713a2b4850 2024.12.16 11:34:45.418052 [ 4182 ] {9c0cf181-2953-4869-9670-d68809ed0e20} TCPHandler: Can't send logs to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:9000 -> [::1]:53020). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:169: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000134e8a44 7. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 8. /build/src/Server/TCPHandler.cpp:2253: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x000000001d487055 9. /build/src/Server/TCPHandler.cpp:2330: DB::TCPHandler::sendLogs() @ 0x000000001d47bdff 10. /build/src/Server/TCPHandler.cpp:693: DB::TCPHandler::runImpl() @ 0x000000001d4712c2 11. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 12. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 13. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 14. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 15. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 16. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 17. ? @ 0x00007f713a222ac3 18. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:45.417456 [ 5023 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a09d07 4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0de47 5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022894827 6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a416b 7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x00000000228a2b09 8. /build/base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::peerAddress() @ 0x00000000228a6a1e 9. /build/base/poco/Net/include/Poco/Net/Socket.h:596: Poco::Net::Socket::peerAddress() const @ 0x00000000133cec28 10. /build/base/poco/Net/src/HTTPServerSession.cpp:65: Poco::Net::HTTPServerSession::clientAddress() @ 0x00000000228831b0 11. /build/src/Server/HTTP/HTTPServerRequest.cpp:34: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&, StrongTypedef const&) @ 0x000000001d4968f9 12. /build/src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x000000001d49595c 13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 18. ? @ 0x00007f713a222ac3 19. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:45.401673 [ 8541 ] {c1fe79d5-1d2b-4203-87db-5a90d25355bd} executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:35656): While executing TabSeparatedRowOutputFormat. (NETWORK_ERROR) (version 24.3.12.76.altinitystable) (from [::1]:35656) (in query: EXISTS TABLE test.hits ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Processors/Formats/IOutputFormat.cpp:111: DB::IOutputFormat::flush() @ 0x000000001d547b9c 13. /build/src/Processors/Formats/IOutputFormat.cpp:0: DB::IOutputFormat::work() @ 0x000000001d5478f4 14. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 15. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 16. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 17. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 18. /build/src/Processors/Executors/PipelineExecutor.cpp:411: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514ed5 19. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 20. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 21. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 22. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 23. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 24. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 25. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 26. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 27. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 28. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 29. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 30. ? @ 0x00007f713a222ac3 31. ? @ 0x00007f713a2b4850 2024.12.16 11:34:45.401752 [ 8545 ] {d632a811-8cb8-4d1b-8e29-eed0a9f0a17b} executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:57338): While executing TabSeparatedRowOutputFormat. (NETWORK_ERROR) (version 24.3.12.76.altinitystable) (from [::1]:57338) (in query: EXISTS TABLE test.hits ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Processors/Formats/IOutputFormat.cpp:111: DB::IOutputFormat::flush() @ 0x000000001d547b9c 13. /build/src/Processors/Formats/IOutputFormat.cpp:0: DB::IOutputFormat::work() @ 0x000000001d5478f4 14. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 15. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 16. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 17. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 18. /build/src/Processors/Executors/PipelineExecutor.cpp:411: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514ed5 19. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 20. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 21. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 22. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 23. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 24. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 25. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 26. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 27. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 28. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 29. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 30. ? @ 0x00007f713a222ac3 31. ? @ 0x00007f713a2b4850 2024.12.16 11:34:45.395660 [ 8506 ] {9c38e6cf-8486-46f4-8cd7-973c72337f4f} executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:59162): While executing TabSeparatedRowOutputFormat. (NETWORK_ERROR) (version 24.3.12.76.altinitystable) (from [::1]:59162) (in query: EXISTS TABLE test.hits ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Processors/Formats/IOutputFormat.cpp:111: DB::IOutputFormat::flush() @ 0x000000001d547b9c 13. /build/src/Processors/Formats/IOutputFormat.cpp:0: DB::IOutputFormat::work() @ 0x000000001d5478f4 14. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 15. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 16. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 17. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 18. /build/src/Processors/Executors/PipelineExecutor.cpp:411: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514ed5 19. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 20. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 21. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 22. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 23. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 24. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 25. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 26. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 27. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 28. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 29. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 30. ? @ 0x00007f713a222ac3 31. ? @ 0x00007f713a2b4850 2024.12.16 11:34:45.401662 [ 8512 ] {38736ac8-fda5-490d-8faf-03c19e915abd} executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:40852): While executing TabSeparatedRowOutputFormat. (NETWORK_ERROR) (version 24.3.12.76.altinitystable) (from [::1]:40852) (in query: EXISTS TABLE test.hits ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Processors/Formats/IOutputFormat.cpp:111: DB::IOutputFormat::flush() @ 0x000000001d547b9c 13. /build/src/Processors/Formats/IOutputFormat.cpp:0: DB::IOutputFormat::work() @ 0x000000001d5478f4 14. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 15. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 16. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 17. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 18. /build/src/Processors/Executors/PipelineExecutor.cpp:411: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514ed5 19. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 20. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 21. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 22. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 23. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 24. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 25. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 26. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 27. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 28. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 29. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 30. ? @ 0x00007f713a222ac3 31. ? @ 0x00007f713a2b4850 2024.12.16 11:34:45.421334 [ 8535 ] {f4af0b2f-7e1b-44ff-b647-d199b1cd1928} DynamicQueryHandler: Cannot flush data to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:40018). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:184: DB::WriteBufferFromHTTPServerResponse::finalizeImpl() @ 0x000000001d49e9d2 11. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 12. /build/src/Server/HTTPHandler.h:94: DB::HTTPHandler::Output::finalize() @ 0x000000001d3ea829 13. /build/src/Server/HTTPHandler.cpp:910: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da5ca 14. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:45.635949 [ 3868 ] {aac2f946-ffcf-4171-9454-0be2adccf38a} zkutil::EphemeralNodeHolder::~EphemeralNodeHolder(): Cannot remove /test/db/test_14/replicas/s1|r1/active: Code: 999. Coordination::Exception: Coordination error: Connection loss, path /test/db/test_14/replicas/s1|r1/active. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, String const&) @ 0x0000000018fcc42c 6. /build/src/Common/ZooKeeper/IKeeper.h:488: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, String const&) @ 0x0000000018fcc27d 7. /build/src/Common/ZooKeeper/IKeeper.h:501: Coordination::Exception::fromPath(Coordination::Error, String const&) @ 0x0000000018fc990c 8. /build/src/Common/ZooKeeper/ZooKeeper.cpp:472: zkutil::ZooKeeper::tryRemove(String const&, int) @ 0x000000001e1b2f90 9. /build/src/Common/ZooKeeper/ZooKeeper.h:760: zkutil::EphemeralNodeHolder::~EphemeralNodeHolder() @ 0x000000001a1330c2 10. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:64: void std::__destroy_at[abi:v15000](zkutil::EphemeralNodeHolder*) @ 0x000000001a13302d 11. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:89: void std::destroy_at[abi:v15000](zkutil::EphemeralNodeHolder*) @ 0x000000001a132fd5 12. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:321: void std::allocator_traits>::destroy[abi:v15000](std::allocator&, zkutil::EphemeralNodeHolder*) @ 0x000000001a132fb9 13. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:309: std::__shared_ptr_emplace>::__on_zero_shared() @ 0x000000001a132b2e 14. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:175: std::__shared_count::__release_shared[abi:v15000]() @ 0x000000000a8f6414 15. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:215: std::__shared_weak_count::__release_shared[abi:v15000]() @ 0x000000000a8f63b9 16. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:703: std::shared_ptr::~shared_ptr[abi:v15000]() @ 0x000000001a131c4c 17. /build/src/Databases/DatabaseReplicatedWorker.h:22: DB::DatabaseReplicatedDDLWorker::~DatabaseReplicatedDDLWorker() @ 0x000000001a13240e 18. /build/src/Databases/DatabaseReplicatedWorker.h:22: DB::DatabaseReplicatedDDLWorker::~DatabaseReplicatedDDLWorker() @ 0x000000001a132479 19. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:49: std::default_delete::operator()[abi:v15000](DB::DatabaseReplicatedDDLWorker*) const @ 0x000000001a11ebb4 20. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:306: std::unique_ptr>::reset[abi:v15000](DB::DatabaseReplicatedDDLWorker*) @ 0x000000001a11eb1c 21. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:263: std::unique_ptr>::operator=[abi:v15000](std::nullptr_t) @ 0x000000001a111dc1 22. /build/src/Databases/DatabaseReplicated.cpp:1334: DB::DatabaseReplicated::shutdown() @ 0x000000001a1083e3 23. /build/src/Interpreters/DatabaseCatalog.cpp:600: DB::DatabaseCatalog::detachDatabase(std::shared_ptr, String const&, bool, bool) @ 0x000000001a672322 24. /build/src/Interpreters/InterpreterDropQuery.cpp:436: DB::InterpreterDropQuery::executeToDatabaseImpl(DB::ASTDropQuery const&, std::shared_ptr&, std::vector, DB::UUIDTag>, std::allocator, DB::UUIDTag>>>&) @ 0x000000001b03f4d3 25. /build/src/Interpreters/InterpreterDropQuery.cpp:335: DB::InterpreterDropQuery::executeToDatabase(DB::ASTDropQuery const&) @ 0x000000001b03b6d9 26. /build/src/Interpreters/InterpreterDropQuery.cpp:81: DB::InterpreterDropQuery::execute() @ 0x000000001b03ae04 27. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 28. /build/src/Interpreters/executeQuery.cpp:1496: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb4e89 29. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 30. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 31. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:45.765931 [ 8528 ] {} BaseDaemon: 7. /build/src/Daemon/BaseDaemon.cpp:0: terminate_handler() @ 0x00000000137245b0 2024.12.16 11:34:45.886237 [ 8528 ] {} BaseDaemon: 8. /build/contrib/llvm-project/libcxxabi/src/cxa_handlers.cpp:59: std::__terminate(void (*)()) @ 0x00000000261721d2 2024.12.16 11:34:45.932908 [ 8528 ] {} BaseDaemon: 9. /build/contrib/llvm-project/libcxxabi/src/cxa_handlers.cpp:89: std::terminate() @ 0x0000000026172106 2024.12.16 11:34:45.994405 [ 3278 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3522: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000001c525e62 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:335: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_1::operator()() const @ 0x000000001c5bde58 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5bde35 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5bde15 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5bddf5 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5bddbd 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:46.275262 [ 3268 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsUpdatingTask(): Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/ZooKeeper/IKeeper.h:475: Coordination::Exception::Exception(char const (&) [16], Coordination::Error) @ 0x000000001e206a04 6. /build/src/Common/ZooKeeper/IKeeper.h:509: Coordination::Exception Coordination::Exception::fromMessage(Coordination::Error, char const (&) [16]) @ 0x000000001e1efaa6 7. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:1188: Coordination::ZooKeeper::pushRequest(Coordination::ZooKeeper::RequestInfo&&) @ 0x000000001e2491e0 8. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:1400: Coordination::ZooKeeper::list(String const&, Coordination::ListRequestType, std::function, std::shared_ptr>) @ 0x000000001e24b39d 9. /build/src/Common/ZooKeeper/ZooKeeper.cpp:1192: zkutil::ZooKeeper::asyncTryGetChildrenNoThrow(String const&, std::shared_ptr>, Coordination::ListRequestType) @ 0x000000001e1b02fc 10. /build/src/Common/ZooKeeper/ZooKeeper.cpp:216: zkutil::ZooKeeper::getChildrenImpl(String const&, std::vector>&, Coordination::Stat*, std::shared_ptr>, Coordination::ListRequestType) @ 0x000000001e1afe94 11. /build/src/Common/ZooKeeper/ZooKeeper.cpp:289: zkutil::ZooKeeper::tryGetChildrenWatch(String const&, std::vector>&, Coordination::Stat*, std::shared_ptr>, Coordination::ListRequestType) @ 0x000000001e1b0a5b 12. /build/src/Common/ZooKeeper/ZooKeeper.cpp:254: zkutil::ZooKeeper::getChildrenWatch(String const&, Coordination::Stat*, std::shared_ptr>, Coordination::ListRequestType) @ 0x000000001e1b0947 13. /build/src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp:910: DB::ReplicatedMergeTreeQueue::updateMutations(std::shared_ptr, std::shared_ptr>) @ 0x000000001d03c1f0 14. /build/src/Storages/StorageReplicatedMergeTree.cpp:3557: DB::StorageReplicatedMergeTree::mutationsUpdatingTask() @ 0x000000001c5263a5 15. /build/src/Storages/StorageReplicatedMergeTree.cpp:340: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_2::operator()() const @ 0x000000001c5be078 16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be055 17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be035 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be015 19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5bdfdd 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 22. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 23. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 24. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 26. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 27. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 28. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:46.292434 [ 8533 ] {0932cc5a-6626-41d0-b078-4dc1ec80c863} DynamicQueryHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:48132): While executing TabSeparatedRowOutputFormat. (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Processors/Formats/IOutputFormat.cpp:111: DB::IOutputFormat::flush() @ 0x000000001d547b9c 13. /build/src/Processors/Formats/IOutputFormat.cpp:0: DB::IOutputFormat::work() @ 0x000000001d5478f4 14. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 15. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 16. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 17. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 18. /build/src/Processors/Executors/PipelineExecutor.cpp:411: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514ed5 19. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 20. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 21. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 22. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 23. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 24. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 25. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 26. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 27. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 28. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 29. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 30. ? @ 0x00007f713a222ac3 31. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:46.292492 [ 8544 ] {4a8e9f14-c4f0-4a9f-b727-1bef9208abe9} DynamicQueryHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:54992): While executing TabSeparatedRowOutputFormat. (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Processors/Formats/IOutputFormat.cpp:111: DB::IOutputFormat::flush() @ 0x000000001d547b9c 13. /build/src/Processors/Formats/IOutputFormat.cpp:0: DB::IOutputFormat::work() @ 0x000000001d5478f4 14. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 15. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 16. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 17. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 18. /build/src/Processors/Executors/PipelineExecutor.cpp:411: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514ed5 19. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 20. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 21. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 22. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 23. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 24. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 25. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 26. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 27. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 28. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 29. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 30. ? @ 0x00007f713a222ac3 31. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:46.292562 [ 8549 ] {fdb4d478-0c83-473b-8fdd-4cae30c72743} executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:40102): While executing TabSeparatedRowOutputFormat. (NETWORK_ERROR) (version 24.3.12.76.altinitystable) (from [::1]:40102) (in query: EXISTS TABLE test.hits ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Processors/Formats/IOutputFormat.cpp:111: DB::IOutputFormat::flush() @ 0x000000001d547b9c 13. /build/src/Processors/Formats/IOutputFormat.cpp:0: DB::IOutputFormat::work() @ 0x000000001d5478f4 14. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 15. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 16. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 17. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 18. /build/src/Processors/Executors/PipelineExecutor.cpp:411: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514ed5 19. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 20. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 21. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 22. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 23. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 24. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 25. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 26. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 27. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 28. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 29. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 30. ? @ 0x00007f713a222ac3 31. ? @ 0x00007f713a2b4850 2024.12.16 11:34:46.292359 [ 8504 ] {433fadc3-62e8-4075-9cda-6d12a0dd5c81} executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:46232): While executing TabSeparatedRowOutputFormat. (NETWORK_ERROR) (version 24.3.12.76.altinitystable) (from [::1]:46232) (in query: EXISTS TABLE test.hits ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Processors/Formats/IOutputFormat.cpp:111: DB::IOutputFormat::flush() @ 0x000000001d547b9c 13. /build/src/Processors/Formats/IOutputFormat.cpp:0: DB::IOutputFormat::work() @ 0x000000001d5478f4 14. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 15. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 16. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 17. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 18. /build/src/Processors/Executors/PipelineExecutor.cpp:411: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514ed5 19. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 20. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 21. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 22. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 23. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 24. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 25. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 26. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 27. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 28. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 29. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 30. ? @ 0x00007f713a222ac3 31. ? @ 0x00007f713a2b4850 2024.12.16 11:34:46.469215 [ 8513 ] {b90e7b5b-f4c8-4c48-b014-76ef34485ca2} executeQuery: Code: 253. DB::Exception: Replica r1 of shard s1 of replicated database at /test/db/test_14 already exists. Replica host ID: 'ed2a21f3ed57:9000:9c868dce-a0aa-41d2-9491-b3682ddb4e9a', current host ID: 'ed2a21f3ed57:9000:096f6368-4213-4814-afe6-62f5c1b181c9'. (REPLICA_ALREADY_EXISTS) (version 24.3.12.76.altinitystable) (from [::1]:45268) (comment: 02233_set_enable_with_statement_cte_perf.sql) (in query: CREATE DATABASE IF NOT EXISTS test_87dkfmwh ENGINE=Replicated('/test/db/test_14', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, String&, String&, String&, String&, String&) @ 0x000000001a1115da 6. /build/src/Databases/DatabaseReplicated.cpp:375: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000001a0ed3e9 7. /build/src/Databases/DatabaseReplicated.cpp:543: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000001a0f0271 8. /build/src/Databases/TablesLoader.cpp:57: DB::TablesLoader::loadTablesAsync(std::unordered_set, std::hash>, std::equal_to>, std::allocator>>) @ 0x000000001b02ffba 9. /build/src/Interpreters/InterpreterCreateQuery.cpp:338: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000001b00b2ef 10. /build/src/Interpreters/InterpreterCreateQuery.cpp:1791: DB::InterpreterCreateQuery::execute() @ 0x000000001b02103f 11. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 12. /build/src/Interpreters/executeQuery.cpp:1496: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb4e89 13. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 14. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 2024.12.16 11:34:46.469231 [ 3269 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:46.470203 [ 8542 ] {905fa144-d6d3-4c2b-800d-5fab79b50083} DynamicQueryHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:35666): While executing TabSeparatedRowOutputFormat. (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Processors/Formats/IOutputFormat.cpp:111: DB::IOutputFormat::flush() @ 0x000000001d547b9c 13. /build/src/Processors/Formats/IOutputFormat.cpp:0: DB::IOutputFormat::work() @ 0x000000001d5478f4 14. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 15. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 16. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 17. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 18. /build/src/Processors/Executors/PipelineExecutor.cpp:411: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514ed5 19. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 20. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 21. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 22. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 23. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 24. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 25. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 26. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 27. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 28. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 29. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 30. ? @ 0x00007f713a222ac3 31. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:46.470582 [ 8543 ] {bc6e40fb-6d11-4b3e-b5ca-f58afe01a76d} DynamicQueryHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:54990): While executing TabSeparatedRowOutputFormat. (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Processors/Formats/IOutputFormat.cpp:111: DB::IOutputFormat::flush() @ 0x000000001d547b9c 13. /build/src/Processors/Formats/IOutputFormat.cpp:0: DB::IOutputFormat::work() @ 0x000000001d5478f4 14. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 15. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 16. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 17. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 18. /build/src/Processors/Executors/PipelineExecutor.cpp:411: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514ed5 19. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 20. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 21. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 22. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 23. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 24. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 25. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 26. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 27. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 28. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 29. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 30. ? @ 0x00007f713a222ac3 31. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:46.470802 [ 5021 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a09d07 4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0de47 5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022894827 6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a416b 7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x00000000228a2b09 8. /build/base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::peerAddress() @ 0x00000000228a6a1e 9. /build/base/poco/Net/include/Poco/Net/Socket.h:596: Poco::Net::Socket::peerAddress() const @ 0x00000000133cec28 10. /build/base/poco/Net/src/HTTPServerSession.cpp:65: Poco::Net::HTTPServerSession::clientAddress() @ 0x00000000228831b0 11. /build/src/Server/HTTP/HTTPServerRequest.cpp:34: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&, StrongTypedef const&) @ 0x000000001d4968f9 12. /build/src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x000000001d49595c 13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 18. ? @ 0x00007f713a222ac3 19. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:46.474588 [ 8545 ] {d632a811-8cb8-4d1b-8e29-eed0a9f0a17b} DynamicQueryHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:57338): While executing TabSeparatedRowOutputFormat. (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Processors/Formats/IOutputFormat.cpp:111: DB::IOutputFormat::flush() @ 0x000000001d547b9c 13. /build/src/Processors/Formats/IOutputFormat.cpp:0: DB::IOutputFormat::work() @ 0x000000001d5478f4 14. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 15. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 16. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 17. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 18. /build/src/Processors/Executors/PipelineExecutor.cpp:411: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514ed5 19. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 20. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 21. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 22. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 23. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 24. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 25. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 26. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 27. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 28. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 29. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 30. ? @ 0x00007f713a222ac3 31. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:46.469375 [ 8546 ] {b4abf0d2-fa4b-458d-964e-d070dc62efc2} executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:36962): While executing TabSeparatedRowOutputFormat. (NETWORK_ERROR) (version 24.3.12.76.altinitystable) (from [::1]:36962) (in query: EXISTS TABLE test.hits ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Processors/Formats/IOutputFormat.cpp:111: DB::IOutputFormat::flush() @ 0x000000001d547b9c 13. /build/src/Processors/Formats/IOutputFormat.cpp:0: DB::IOutputFormat::work() @ 0x000000001d5478f4 14. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 15. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 16. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 17. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 18. /build/src/Processors/Executors/PipelineExecutor.cpp:411: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514ed5 19. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 20. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 21. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 22. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 23. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 24. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 25. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 26. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 27. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 28. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 29. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 30. ? @ 0x00007f713a222ac3 31. ? @ 0x00007f713a2b4850 2024.12.16 11:34:46.479241 [ 8511 ] {f23f989b-f9c1-47bb-9728-d03bc28b30ef} executeQuery: Code: 253. DB::Exception: Replica r1 of shard s1 of replicated database at /test/db/test_14 already exists. Replica host ID: 'ed2a21f3ed57:9000:9c868dce-a0aa-41d2-9491-b3682ddb4e9a', current host ID: 'ed2a21f3ed57:9000:a222f5d1-128e-47fc-829b-d4fb8d957bbd'. (REPLICA_ALREADY_EXISTS) (version 24.3.12.76.altinitystable) (from [::1]:53758) (comment: 02233_set_enable_with_statement_cte_perf.sql) (in query: CREATE DATABASE IF NOT EXISTS test_87dkfmwh ENGINE=Replicated('/test/db/test_14', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, String&, String&, String&, String&, String&) @ 0x000000001a1115da 6. /build/src/Databases/DatabaseReplicated.cpp:375: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000001a0ed3e9 7. /build/src/Databases/DatabaseReplicated.cpp:543: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000001a0f0271 8. /build/src/Databases/TablesLoader.cpp:57: DB::TablesLoader::loadTablesAsync(std::unordered_set, std::hash>, std::equal_to>, std::allocator>>) @ 0x000000001b02ffba 9. /build/src/Interpreters/InterpreterCreateQuery.cpp:338: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000001b00b2ef 10. /build/src/Interpreters/InterpreterCreateQuery.cpp:1791: DB::InterpreterCreateQuery::execute() @ 0x000000001b02103f 11. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 12. /build/src/Interpreters/executeQuery.cpp:1496: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb4e89 13. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 14. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 2024.12.16 11:34:46.654933 [ 8524 ] {424fa945-4d36-4fc9-893c-372e43965ea0} executeQuery: Code: 999. Coordination::Exception: Coordination error: Session expired, path /test/db/test_14. (KEEPER_EXCEPTION) (version 24.3.12.76.altinitystable) (from [::1]:48454) (comment: 01136_multiple_sets.sql) (in query: CREATE DATABASE IF NOT EXISTS test_9ni4o4sn ENGINE=Replicated('/test/db/test_14', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, String const&) @ 0x0000000018fcc42c 6. /build/src/Common/ZooKeeper/IKeeper.h:488: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, String const&) @ 0x0000000018fcc27d 7. /build/src/Common/ZooKeeper/IKeeper.h:501: Coordination::Exception::fromPath(Coordination::Error, String const&) @ 0x0000000018fc990c 8. /build/src/Common/ZooKeeper/ZooKeeper.cpp:517: zkutil::ZooKeeper::existsWatch(String const&, Coordination::Stat*, std::function) @ 0x000000001e1b3633 9. /build/src/Common/ZooKeeper/ZooKeeper.cpp:498: zkutil::ZooKeeper::exists(String const&, Coordination::Stat*, std::shared_ptr const&) @ 0x000000001e1b13f6 10. /build/src/Databases/DatabaseReplicated.cpp:352: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000001a0ec616 11. /build/src/Databases/DatabaseReplicated.cpp:543: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000001a0f0271 12. /build/src/Databases/TablesLoader.cpp:57: DB::TablesLoader::loadTablesAsync(std::unordered_set, std::hash>, std::equal_to>, std::allocator>>) @ 0x000000001b02ffba 13. /build/src/Interpreters/InterpreterCreateQuery.cpp:338: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000001b00b2ef 14. /build/src/Interpreters/InterpreterCreateQuery.cpp:1791: DB::InterpreterCreateQuery::execute() @ 0x000000001b02103f 15. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 16. /build/src/Interpreters/executeQuery.cpp:1496: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb4e89 17. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 18. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 19. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 20. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 21. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 22. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 23. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 24. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 25. ? @ 0x00007f713a222ac3 26. ? @ 0x00007f713a2b4850 2024.12.16 11:34:46.654988 [ 8508 ] {e908df23-54cf-4935-857b-2e4d9e700835} DynamicQueryHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:59176): While executing TabSeparatedRowOutputFormat. (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Processors/Formats/IOutputFormat.cpp:111: DB::IOutputFormat::flush() @ 0x000000001d547b9c 13. /build/src/Processors/Formats/IOutputFormat.cpp:0: DB::IOutputFormat::work() @ 0x000000001d5478f4 14. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 15. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 16. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 17. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 18. /build/src/Processors/Executors/PipelineExecutor.cpp:411: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514ed5 19. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 20. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 21. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 22. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 23. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 24. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 25. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 26. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 27. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 28. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 29. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 30. ? @ 0x00007f713a222ac3 31. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:46.655065 [ 8522 ] {2f5f9f60-72d7-4c7c-ac18-eea556b3cf09} executeQuery: Code: 253. DB::Exception: Replica r1 of shard s1 of replicated database at /test/db/test_14 already exists. Replica host ID: 'ed2a21f3ed57:9000:9c868dce-a0aa-41d2-9491-b3682ddb4e9a', current host ID: 'ed2a21f3ed57:9000:d6beee50-362b-464f-a4c9-7807f6aab4fb'. (REPLICA_ALREADY_EXISTS) (version 24.3.12.76.altinitystable) (from [::1]:42346) (comment: 01136_multiple_sets.sql) (in query: CREATE DATABASE IF NOT EXISTS test_9ni4o4sn ENGINE=Replicated('/test/db/test_14', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, String&, String&, String&, String&, String&) @ 0x000000001a1115da 6. /build/src/Databases/DatabaseReplicated.cpp:375: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000001a0ed3e9 7. /build/src/Databases/DatabaseReplicated.cpp:543: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000001a0f0271 8. /build/src/Databases/TablesLoader.cpp:57: DB::TablesLoader::loadTablesAsync(std::unordered_set, std::hash>, std::equal_to>, std::allocator>>) @ 0x000000001b02ffba 9. /build/src/Interpreters/InterpreterCreateQuery.cpp:338: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000001b00b2ef 10. /build/src/Interpreters/InterpreterCreateQuery.cpp:1791: DB::InterpreterCreateQuery::execute() @ 0x000000001b02103f 11. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 12. /build/src/Interpreters/executeQuery.cpp:1496: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb4e89 13. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 14. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 2024.12.16 11:34:46.655318 [ 8506 ] {9c38e6cf-8486-46f4-8cd7-973c72337f4f} DynamicQueryHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:59162): While executing TabSeparatedRowOutputFormat. (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Processors/Formats/IOutputFormat.cpp:111: DB::IOutputFormat::flush() @ 0x000000001d547b9c 13. /build/src/Processors/Formats/IOutputFormat.cpp:0: DB::IOutputFormat::work() @ 0x000000001d5478f4 14. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 15. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 16. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 17. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 18. /build/src/Processors/Executors/PipelineExecutor.cpp:411: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514ed5 19. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 20. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 21. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 22. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 23. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 24. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 25. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 26. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 27. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 28. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 29. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 30. ? @ 0x00007f713a222ac3 31. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:46.655380 [ 8526 ] {37cf0e5e-5312-41c3-93fa-751a8ccd7ef0} zkutil::EphemeralNodeHolder::~EphemeralNodeHolder(): Cannot remove /test/db/test_8/replicas/s1|r1/active: Code: 999. Coordination::Exception: Coordination error: Session expired, path /test/db/test_8/replicas/s1|r1/active. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, String const&) @ 0x0000000018fcc42c 6. /build/src/Common/ZooKeeper/IKeeper.h:488: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, String const&) @ 0x0000000018fcc27d 7. /build/src/Common/ZooKeeper/IKeeper.h:501: Coordination::Exception::fromPath(Coordination::Error, String const&) @ 0x0000000018fc990c 8. /build/src/Common/ZooKeeper/ZooKeeper.cpp:472: zkutil::ZooKeeper::tryRemove(String const&, int) @ 0x000000001e1b2f90 9. /build/src/Common/ZooKeeper/ZooKeeper.h:760: zkutil::EphemeralNodeHolder::~EphemeralNodeHolder() @ 0x000000001a1330c2 10. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:64: void std::__destroy_at[abi:v15000](zkutil::EphemeralNodeHolder*) @ 0x000000001a13302d 11. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:89: void std::destroy_at[abi:v15000](zkutil::EphemeralNodeHolder*) @ 0x000000001a132fd5 12. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:321: void std::allocator_traits>::destroy[abi:v15000](std::allocator&, zkutil::EphemeralNodeHolder*) @ 0x000000001a132fb9 13. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:309: std::__shared_ptr_emplace>::__on_zero_shared() @ 0x000000001a132b2e 14. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:175: std::__shared_count::__release_shared[abi:v15000]() @ 0x000000000a8f6414 15. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:215: std::__shared_weak_count::__release_shared[abi:v15000]() @ 0x000000000a8f63b9 16. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:703: std::shared_ptr::~shared_ptr[abi:v15000]() @ 0x000000001a131c4c 17. /build/src/Databases/DatabaseReplicatedWorker.h:22: DB::DatabaseReplicatedDDLWorker::~DatabaseReplicatedDDLWorker() @ 0x000000001a13240e 18. /build/src/Databases/DatabaseReplicatedWorker.h:22: DB::DatabaseReplicatedDDLWorker::~DatabaseReplicatedDDLWorker() @ 0x000000001a132479 19. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:49: std::default_delete::operator()[abi:v15000](DB::DatabaseReplicatedDDLWorker*) const @ 0x000000001a11ebb4 20. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:306: std::unique_ptr>::reset[abi:v15000](DB::DatabaseReplicatedDDLWorker*) @ 0x000000001a11eb1c 21. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:263: std::unique_ptr>::operator=[abi:v15000](std::nullptr_t) @ 0x000000001a111dc1 22. /build/src/Databases/DatabaseReplicated.cpp:1334: DB::DatabaseReplicated::shutdown() @ 0x000000001a1083e3 23. /build/src/Interpreters/DatabaseCatalog.cpp:600: DB::DatabaseCatalog::detachDatabase(std::shared_ptr, String const&, bool, bool) @ 0x000000001a672322 24. /build/src/Interpreters/InterpreterDropQuery.cpp:436: DB::InterpreterDropQuery::executeToDatabaseImpl(DB::ASTDropQuery const&, std::shared_ptr&, std::vector, DB::UUIDTag>, std::allocator, DB::UUIDTag>>>&) @ 0x000000001b03f4d3 25. /build/src/Interpreters/InterpreterDropQuery.cpp:335: DB::InterpreterDropQuery::executeToDatabase(DB::ASTDropQuery const&) @ 0x000000001b03b6d9 26. /build/src/Interpreters/InterpreterDropQuery.cpp:81: DB::InterpreterDropQuery::execute() @ 0x000000001b03ae04 27. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 28. /build/src/Interpreters/executeQuery.cpp:1496: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb4e89 29. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 30. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 31. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:46.655388 [ 8530 ] {8afb4826-0dd0-4cbe-8f8d-c335c7068a41} executeQuery: Code: 253. DB::Exception: Replica r1 of shard s1 of replicated database at /test/db/test_14 already exists. Replica host ID: 'ed2a21f3ed57:9000:9c868dce-a0aa-41d2-9491-b3682ddb4e9a', current host ID: 'ed2a21f3ed57:9000:373eb6f4-8ded-4880-a0ca-32b71d9be05e'. (REPLICA_ALREADY_EXISTS) (version 24.3.12.76.altinitystable) (from [::1]:59922) (comment: 01136_multiple_sets.sql) (in query: CREATE DATABASE IF NOT EXISTS test_9ni4o4sn ENGINE=Replicated('/test/db/test_14', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, String&, String&, String&, String&, String&) @ 0x000000001a1115da 6. /build/src/Databases/DatabaseReplicated.cpp:375: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000001a0ed3e9 7. /build/src/Databases/DatabaseReplicated.cpp:543: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000001a0f0271 8. /build/src/Databases/TablesLoader.cpp:57: DB::TablesLoader::loadTablesAsync(std::unordered_set, std::hash>, std::equal_to>, std::allocator>>) @ 0x000000001b02ffba 9. /build/src/Interpreters/InterpreterCreateQuery.cpp:338: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000001b00b2ef 10. /build/src/Interpreters/InterpreterCreateQuery.cpp:1791: DB::InterpreterCreateQuery::execute() @ 0x000000001b02103f 11. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 12. /build/src/Interpreters/executeQuery.cpp:1496: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb4e89 13. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 14. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 2024.12.16 11:34:46.656849 [ 8523 ] {a2f55439-637e-4f14-94f3-a591ccb01889} executeQuery: Code: 253. DB::Exception: Replica r1 of shard s1 of replicated database at /test/db/test_14 already exists. Replica host ID: 'ed2a21f3ed57:9000:9c868dce-a0aa-41d2-9491-b3682ddb4e9a', current host ID: 'ed2a21f3ed57:9000:47d4db15-d073-45e9-9f3d-66abb4f27d46'. (REPLICA_ALREADY_EXISTS) (version 24.3.12.76.altinitystable) (from [::1]:47898) (comment: 01136_multiple_sets.sql) (in query: CREATE DATABASE IF NOT EXISTS test_9ni4o4sn ENGINE=Replicated('/test/db/test_14', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, String&, String&, String&, String&, String&) @ 0x000000001a1115da 6. /build/src/Databases/DatabaseReplicated.cpp:375: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000001a0ed3e9 7. /build/src/Databases/DatabaseReplicated.cpp:543: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000001a0f0271 8. /build/src/Databases/TablesLoader.cpp:57: DB::TablesLoader::loadTablesAsync(std::unordered_set, std::hash>, std::equal_to>, std::allocator>>) @ 0x000000001b02ffba 9. /build/src/Interpreters/InterpreterCreateQuery.cpp:338: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000001b00b2ef 10. /build/src/Interpreters/InterpreterCreateQuery.cpp:1791: DB::InterpreterCreateQuery::execute() @ 0x000000001b02103f 11. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 12. /build/src/Interpreters/executeQuery.cpp:1496: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb4e89 13. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 14. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 2024.12.16 11:34:46.656928 [ 8510 ] {42a22cd2-296e-4347-83d2-1acbf5e30df5} DynamicQueryHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:40850): While executing TabSeparatedRowOutputFormat. (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Processors/Formats/IOutputFormat.cpp:111: DB::IOutputFormat::flush() @ 0x000000001d547b9c 13. /build/src/Processors/Formats/IOutputFormat.cpp:0: DB::IOutputFormat::work() @ 0x000000001d5478f4 14. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 15. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 16. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 17. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 18. /build/src/Processors/Executors/PipelineExecutor.cpp:411: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514ed5 19. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 20. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 21. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 22. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 23. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 24. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 25. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 26. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 27. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 28. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 29. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 30. ? @ 0x00007f713a222ac3 31. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:46.656849 [ 8509 ] {1b750de3-7821-407b-882c-618d1495cb17} executeQuery: Code: 999. Coordination::Exception: Coordination error: Session expired, path /test/db/test_14. (KEEPER_EXCEPTION) (version 24.3.12.76.altinitystable) (from [::1]:55410) (comment: 02233_set_enable_with_statement_cte_perf.sql) (in query: CREATE DATABASE IF NOT EXISTS test_87dkfmwh ENGINE=Replicated('/test/db/test_14', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, String const&) @ 0x0000000018fcc42c 6. /build/src/Common/ZooKeeper/IKeeper.h:488: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, String const&) @ 0x0000000018fcc27d 7. /build/src/Common/ZooKeeper/IKeeper.h:501: Coordination::Exception::fromPath(Coordination::Error, String const&) @ 0x0000000018fc990c 8. /build/src/Common/ZooKeeper/ZooKeeper.cpp:517: zkutil::ZooKeeper::existsWatch(String const&, Coordination::Stat*, std::function) @ 0x000000001e1b3633 9. /build/src/Common/ZooKeeper/ZooKeeper.cpp:498: zkutil::ZooKeeper::exists(String const&, Coordination::Stat*, std::shared_ptr const&) @ 0x000000001e1b13f6 10. /build/src/Databases/DatabaseReplicated.cpp:352: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000001a0ec616 11. /build/src/Databases/DatabaseReplicated.cpp:543: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000001a0f0271 12. /build/src/Databases/TablesLoader.cpp:57: DB::TablesLoader::loadTablesAsync(std::unordered_set, std::hash>, std::equal_to>, std::allocator>>) @ 0x000000001b02ffba 13. /build/src/Interpreters/InterpreterCreateQuery.cpp:338: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000001b00b2ef 14. /build/src/Interpreters/InterpreterCreateQuery.cpp:1791: DB::InterpreterCreateQuery::execute() @ 0x000000001b02103f 15. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 16. /build/src/Interpreters/executeQuery.cpp:1496: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb4e89 17. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 18. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 19. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 20. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 21. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 22. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 23. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 24. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 25. ? @ 0x00007f713a222ac3 26. ? @ 0x00007f713a2b4850 2024.12.16 11:34:46.657019 [ 2758 ] {ffc25f4e-7b65-4387-bb12-beb3ac374e39} executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:51622): While executing TabSeparatedRowOutputFormat. (NETWORK_ERROR) (version 24.3.12.76.altinitystable) (from [::1]:51622) (in query: EXISTS TABLE test.hits ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Processors/Formats/IOutputFormat.cpp:111: DB::IOutputFormat::flush() @ 0x000000001d547b9c 13. /build/src/Processors/Formats/IOutputFormat.cpp:0: DB::IOutputFormat::work() @ 0x000000001d5478f4 14. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 15. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 16. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 17. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 18. /build/src/Processors/Executors/PipelineExecutor.cpp:411: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514ed5 19. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 20. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 21. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 22. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 23. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 24. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 25. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 26. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 27. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 28. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 29. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 30. ? @ 0x00007f713a222ac3 31. ? @ 0x00007f713a2b4850 2024.12.16 11:34:46.657583 [ 8518 ] {fb7d7adf-eda4-4dd2-8fcf-344c437f32ec} executeQuery: Code: 253. DB::Exception: Replica r1 of shard s1 of replicated database at /test/db/test_14 already exists. Replica host ID: 'ed2a21f3ed57:9000:9c868dce-a0aa-41d2-9491-b3682ddb4e9a', current host ID: 'ed2a21f3ed57:9000:a8d4a398-e372-46e8-85fd-5b572198a644'. (REPLICA_ALREADY_EXISTS) (version 24.3.12.76.altinitystable) (from [::1]:57052) (comment: 01076_range_reader_segfault.sql) (in query: CREATE DATABASE IF NOT EXISTS test_ewqhd64b ENGINE=Replicated('/test/db/test_14', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, String&, String&, String&, String&, String&) @ 0x000000001a1115da 6. /build/src/Databases/DatabaseReplicated.cpp:375: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000001a0ed3e9 7. /build/src/Databases/DatabaseReplicated.cpp:543: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000001a0f0271 8. /build/src/Databases/TablesLoader.cpp:57: DB::TablesLoader::loadTablesAsync(std::unordered_set, std::hash>, std::equal_to>, std::allocator>>) @ 0x000000001b02ffba 9. /build/src/Interpreters/InterpreterCreateQuery.cpp:338: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000001b00b2ef 10. /build/src/Interpreters/InterpreterCreateQuery.cpp:1791: DB::InterpreterCreateQuery::execute() @ 0x000000001b02103f 11. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 12. /build/src/Interpreters/executeQuery.cpp:1496: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb4e89 13. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 14. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 2024.12.16 11:34:46.880700 [ 8510 ] {42a22cd2-296e-4347-83d2-1acbf5e30df5} DynamicQueryHandler: Cannot send exception to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:40850). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/HTTPServerResponse.h:164: DB::HTTPWriteBuffer::nextImplChunked() @ 0x000000001d49ee29 8. /build/src/Server/HTTP/HTTPServerResponse.h:135: DB::HTTPWriteBuffer::nextImpl() @ 0x000000001d49eaef 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:116: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e3bf 10. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 11. /build/src/Server/HTTPHandler.cpp:955: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db57f 12. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 13. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 14. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 15. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 16. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 17. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 18. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 19. ? @ 0x00007f713a222ac3 20. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:46.880834 [ 8541 ] {c1fe79d5-1d2b-4203-87db-5a90d25355bd} DynamicQueryHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:35656): While executing TabSeparatedRowOutputFormat. (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Processors/Formats/IOutputFormat.cpp:111: DB::IOutputFormat::flush() @ 0x000000001d547b9c 13. /build/src/Processors/Formats/IOutputFormat.cpp:0: DB::IOutputFormat::work() @ 0x000000001d5478f4 14. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 15. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 16. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 17. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 18. /build/src/Processors/Executors/PipelineExecutor.cpp:411: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514ed5 19. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 20. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 21. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 22. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 23. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 24. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 25. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 26. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 27. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 28. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 29. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 30. ? @ 0x00007f713a222ac3 31. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:46.880887 [ 5023 ] {12b6c0a0-d16d-4f75-bf35-4930e765b8d0} DynamicQueryHandler: Cannot flush data to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:41580). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:184: DB::WriteBufferFromHTTPServerResponse::finalizeImpl() @ 0x000000001d49e9d2 11. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 12. /build/src/Server/HTTPHandler.h:94: DB::HTTPHandler::Output::finalize() @ 0x000000001d3ea829 13. /build/src/Server/HTTPHandler.cpp:910: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da5ca 14. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:46.880956 [ 8512 ] {38736ac8-fda5-490d-8faf-03c19e915abd} DynamicQueryHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:40852): While executing TabSeparatedRowOutputFormat. (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Processors/Formats/IOutputFormat.cpp:111: DB::IOutputFormat::flush() @ 0x000000001d547b9c 13. /build/src/Processors/Formats/IOutputFormat.cpp:0: DB::IOutputFormat::work() @ 0x000000001d5478f4 14. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 15. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 16. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 17. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 18. /build/src/Processors/Executors/PipelineExecutor.cpp:411: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514ed5 19. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 20. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 21. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 22. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 23. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 24. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 25. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 26. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 27. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 28. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 29. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 30. ? @ 0x00007f713a222ac3 31. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.096272 [ 8510 ] {42a22cd2-296e-4347-83d2-1acbf5e30df5} DynamicQueryHandler: Cannot flush data to client (after sending exception): Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:40850). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:184: DB::WriteBufferFromHTTPServerResponse::finalizeImpl() @ 0x000000001d49e9d2 11. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 12. /build/src/Server/HTTPHandler.h:94: DB::HTTPHandler::Output::finalize() @ 0x000000001d3ea829 13. /build/src/Server/HTTPHandler.cpp:970: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db33a 14. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.096368 [ 8552 ] {7fe49ba4-63f9-4ed8-ae8a-302c749eb427} executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:36882): While executing TabSeparatedRowOutputFormat. (NETWORK_ERROR) (version 24.3.12.76.altinitystable) (from [::1]:36882) (in query: EXISTS TABLE test.hits ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Processors/Formats/IOutputFormat.cpp:111: DB::IOutputFormat::flush() @ 0x000000001d547b9c 13. /build/src/Processors/Formats/IOutputFormat.cpp:0: DB::IOutputFormat::work() @ 0x000000001d5478f4 14. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 15. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 16. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 17. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 18. /build/src/Processors/Executors/PipelineExecutor.cpp:411: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514ed5 19. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 20. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 21. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 22. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 23. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 24. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 25. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 26. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 27. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 28. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 29. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 30. ? @ 0x00007f713a222ac3 31. ? @ 0x00007f713a2b4850 2024.12.16 11:34:47.097306 [ 8533 ] {0932cc5a-6626-41d0-b078-4dc1ec80c863} DynamicQueryHandler: Cannot send exception to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:48132). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/HTTPServerResponse.h:164: DB::HTTPWriteBuffer::nextImplChunked() @ 0x000000001d49ee29 8. /build/src/Server/HTTP/HTTPServerResponse.h:135: DB::HTTPWriteBuffer::nextImpl() @ 0x000000001d49eaef 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:116: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e3bf 10. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 11. /build/src/Server/HTTPHandler.cpp:955: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db57f 12. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 13. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 14. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 15. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 16. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 17. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 18. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 19. ? @ 0x00007f713a222ac3 20. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.096385 [ 8521 ] {ad56f663-4427-4396-a3f4-f234da72f38f} executeQuery: Code: 253. DB::Exception: Replica r1 of shard s1 of replicated database at /test/db/test_14 already exists. Replica host ID: 'ed2a21f3ed57:9000:9c868dce-a0aa-41d2-9491-b3682ddb4e9a', current host ID: 'ed2a21f3ed57:9000:0cdddd66-cedf-471b-b6c9-fa933aa26e6e'. (REPLICA_ALREADY_EXISTS) (version 24.3.12.76.altinitystable) (from [::1]:47720) (comment: 01076_range_reader_segfault.sql) (in query: CREATE DATABASE IF NOT EXISTS test_ewqhd64b ENGINE=Replicated('/test/db/test_14', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, String&, String&, String&, String&, String&) @ 0x000000001a1115da 6. /build/src/Databases/DatabaseReplicated.cpp:375: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000001a0ed3e9 7. /build/src/Databases/DatabaseReplicated.cpp:543: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000001a0f0271 8. /build/src/Databases/TablesLoader.cpp:57: DB::TablesLoader::loadTablesAsync(std::unordered_set, std::hash>, std::equal_to>, std::allocator>>) @ 0x000000001b02ffba 9. /build/src/Interpreters/InterpreterCreateQuery.cpp:338: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000001b00b2ef 10. /build/src/Interpreters/InterpreterCreateQuery.cpp:1791: DB::InterpreterCreateQuery::execute() @ 0x000000001b02103f 11. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 12. /build/src/Interpreters/executeQuery.cpp:1496: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb4e89 13. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 14. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 2024.12.16 11:34:47.096425 [ 8540 ] {ca3ad549-3c62-4f02-8bf5-7e87173e3681} executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:35780): While executing TabSeparatedRowOutputFormat. (NETWORK_ERROR) (version 24.3.12.76.altinitystable) (from [::1]:35780) (in query: EXISTS TABLE test.hits ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Processors/Formats/IOutputFormat.cpp:111: DB::IOutputFormat::flush() @ 0x000000001d547b9c 13. /build/src/Processors/Formats/IOutputFormat.cpp:0: DB::IOutputFormat::work() @ 0x000000001d5478f4 14. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 15. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 16. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 17. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 18. /build/src/Processors/Executors/PipelineExecutor.cpp:411: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514ed5 19. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 20. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 21. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 22. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 23. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 24. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 25. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 26. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 27. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 28. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 29. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 30. ? @ 0x00007f713a222ac3 31. ? @ 0x00007f713a2b4850 2024.12.16 11:34:47.097818 [ 8513 ] {b90e7b5b-f4c8-4c48-b014-76ef34485ca2} DynamicQueryHandler: Code: 253. DB::Exception: Replica r1 of shard s1 of replicated database at /test/db/test_14 already exists. Replica host ID: 'ed2a21f3ed57:9000:9c868dce-a0aa-41d2-9491-b3682ddb4e9a', current host ID: 'ed2a21f3ed57:9000:096f6368-4213-4814-afe6-62f5c1b181c9'. (REPLICA_ALREADY_EXISTS), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, String&, String&, String&, String&, String&) @ 0x000000001a1115da 6. /build/src/Databases/DatabaseReplicated.cpp:375: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000001a0ed3e9 7. /build/src/Databases/DatabaseReplicated.cpp:543: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000001a0f0271 8. /build/src/Databases/TablesLoader.cpp:57: DB::TablesLoader::loadTablesAsync(std::unordered_set, std::hash>, std::equal_to>, std::allocator>>) @ 0x000000001b02ffba 9. /build/src/Interpreters/InterpreterCreateQuery.cpp:338: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000001b00b2ef 10. /build/src/Interpreters/InterpreterCreateQuery.cpp:1791: DB::InterpreterCreateQuery::execute() @ 0x000000001b02103f 11. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 12. /build/src/Interpreters/executeQuery.cpp:1496: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb4e89 13. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 14. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.097860 [ 8532 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a09d07 4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0de47 5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022894827 6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a416b 7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x00000000228a2b09 8. /build/base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::peerAddress() @ 0x00000000228a6a1e 9. /build/base/poco/Net/include/Poco/Net/Socket.h:596: Poco::Net::Socket::peerAddress() const @ 0x00000000133cec28 10. /build/base/poco/Net/src/HTTPServerSession.cpp:65: Poco::Net::HTTPServerSession::clientAddress() @ 0x00000000228831b0 11. /build/src/Server/HTTP/HTTPServerRequest.cpp:34: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&, StrongTypedef const&) @ 0x000000001d4968f9 12. /build/src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x000000001d49595c 13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 18. ? @ 0x00007f713a222ac3 19. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.096850 [ 8520 ] {09c5bcd9-e183-485c-a05c-620b949a5112} executeQuery: Code: 253. DB::Exception: Replica r1 of shard s1 of replicated database at /test/db/test_14 already exists. Replica host ID: 'ed2a21f3ed57:9000:9c868dce-a0aa-41d2-9491-b3682ddb4e9a', current host ID: 'ed2a21f3ed57:9000:527b26b1-3b1e-4132-a6e4-53a3c0c681a5'. (REPLICA_ALREADY_EXISTS) (version 24.3.12.76.altinitystable) (from [::1]:49556) (comment: 01076_range_reader_segfault.sql) (in query: CREATE DATABASE IF NOT EXISTS test_ewqhd64b ENGINE=Replicated('/test/db/test_14', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, String&, String&, String&, String&, String&) @ 0x000000001a1115da 6. /build/src/Databases/DatabaseReplicated.cpp:375: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000001a0ed3e9 7. /build/src/Databases/DatabaseReplicated.cpp:543: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000001a0f0271 8. /build/src/Databases/TablesLoader.cpp:57: DB::TablesLoader::loadTablesAsync(std::unordered_set, std::hash>, std::equal_to>, std::allocator>>) @ 0x000000001b02ffba 9. /build/src/Interpreters/InterpreterCreateQuery.cpp:338: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000001b00b2ef 10. /build/src/Interpreters/InterpreterCreateQuery.cpp:1791: DB::InterpreterCreateQuery::execute() @ 0x000000001b02103f 11. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 12. /build/src/Interpreters/executeQuery.cpp:1496: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb4e89 13. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 14. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 2024.12.16 11:34:47.096974 [ 8561 ] {8494759c-f556-46f3-af8e-10412ace6f81} DynamicQueryHandler: Cannot flush data to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:47468). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:184: DB::WriteBufferFromHTTPServerResponse::finalizeImpl() @ 0x000000001d49e9d2 11. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 12. /build/src/Server/HTTPHandler.h:94: DB::HTTPHandler::Output::finalize() @ 0x000000001d3ea829 13. /build/src/Server/HTTPHandler.cpp:910: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da5ca 14. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.098197 [ 8546 ] {b4abf0d2-fa4b-458d-964e-d070dc62efc2} DynamicQueryHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:36962): While executing TabSeparatedRowOutputFormat. (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Processors/Formats/IOutputFormat.cpp:111: DB::IOutputFormat::flush() @ 0x000000001d547b9c 13. /build/src/Processors/Formats/IOutputFormat.cpp:0: DB::IOutputFormat::work() @ 0x000000001d5478f4 14. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 15. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 16. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 17. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 18. /build/src/Processors/Executors/PipelineExecutor.cpp:411: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514ed5 19. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 20. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 21. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 22. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 23. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 24. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 25. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 26. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 27. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 28. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 29. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 30. ? @ 0x00007f713a222ac3 31. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.098224 [ 8542 ] {905fa144-d6d3-4c2b-800d-5fab79b50083} DynamicQueryHandler: Cannot send exception to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:35666). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/HTTPServerResponse.h:164: DB::HTTPWriteBuffer::nextImplChunked() @ 0x000000001d49ee29 8. /build/src/Server/HTTP/HTTPServerResponse.h:135: DB::HTTPWriteBuffer::nextImpl() @ 0x000000001d49eaef 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:116: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e3bf 10. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 11. /build/src/Server/HTTPHandler.cpp:955: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db57f 12. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 13. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 14. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 15. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 16. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 17. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 18. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 19. ? @ 0x00007f713a222ac3 20. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.098591 [ 8552 ] {7fe49ba4-63f9-4ed8-ae8a-302c749eb427} DynamicQueryHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:36882): While executing TabSeparatedRowOutputFormat. (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Processors/Formats/IOutputFormat.cpp:111: DB::IOutputFormat::flush() @ 0x000000001d547b9c 13. /build/src/Processors/Formats/IOutputFormat.cpp:0: DB::IOutputFormat::work() @ 0x000000001d5478f4 14. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 15. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 16. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 17. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 18. /build/src/Processors/Executors/PipelineExecutor.cpp:411: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514ed5 19. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 20. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 21. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 22. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 23. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 24. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 25. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 26. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 27. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 28. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 29. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 30. ? @ 0x00007f713a222ac3 31. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.098660 [ 8540 ] {ca3ad549-3c62-4f02-8bf5-7e87173e3681} DynamicQueryHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:35780): While executing TabSeparatedRowOutputFormat. (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Processors/Formats/IOutputFormat.cpp:111: DB::IOutputFormat::flush() @ 0x000000001d547b9c 13. /build/src/Processors/Formats/IOutputFormat.cpp:0: DB::IOutputFormat::work() @ 0x000000001d5478f4 14. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 15. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 16. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 17. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 18. /build/src/Processors/Executors/PipelineExecutor.cpp:411: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514ed5 19. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 20. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 21. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 22. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 23. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 24. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 25. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 26. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 27. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 28. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 29. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 30. ? @ 0x00007f713a222ac3 31. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.098692 [ 8521 ] {ad56f663-4427-4396-a3f4-f234da72f38f} DynamicQueryHandler: Code: 253. DB::Exception: Replica r1 of shard s1 of replicated database at /test/db/test_14 already exists. Replica host ID: 'ed2a21f3ed57:9000:9c868dce-a0aa-41d2-9491-b3682ddb4e9a', current host ID: 'ed2a21f3ed57:9000:0cdddd66-cedf-471b-b6c9-fa933aa26e6e'. (REPLICA_ALREADY_EXISTS), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, String&, String&, String&, String&, String&) @ 0x000000001a1115da 6. /build/src/Databases/DatabaseReplicated.cpp:375: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000001a0ed3e9 7. /build/src/Databases/DatabaseReplicated.cpp:543: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000001a0f0271 8. /build/src/Databases/TablesLoader.cpp:57: DB::TablesLoader::loadTablesAsync(std::unordered_set, std::hash>, std::equal_to>, std::allocator>>) @ 0x000000001b02ffba 9. /build/src/Interpreters/InterpreterCreateQuery.cpp:338: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000001b00b2ef 10. /build/src/Interpreters/InterpreterCreateQuery.cpp:1791: DB::InterpreterCreateQuery::execute() @ 0x000000001b02103f 11. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 12. /build/src/Interpreters/executeQuery.cpp:1496: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb4e89 13. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 14. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.096984 [ 8515 ] {a85a81ea-23ed-4e00-bd58-b4fcbd9ccded} executeQuery: Code: 253. DB::Exception: Replica r1 of shard s1 of replicated database at /test/db/test_14 already exists. Replica host ID: 'ed2a21f3ed57:9000:9c868dce-a0aa-41d2-9491-b3682ddb4e9a', current host ID: 'ed2a21f3ed57:9000:b4518c8f-f371-4914-9f03-43566fe94a68'. (REPLICA_ALREADY_EXISTS) (version 24.3.12.76.altinitystable) (from [::1]:54542) (comment: 02233_set_enable_with_statement_cte_perf.sql) (in query: CREATE DATABASE IF NOT EXISTS test_87dkfmwh ENGINE=Replicated('/test/db/test_14', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, String&, String&, String&, String&, String&) @ 0x000000001a1115da 6. /build/src/Databases/DatabaseReplicated.cpp:375: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000001a0ed3e9 7. /build/src/Databases/DatabaseReplicated.cpp:543: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000001a0f0271 8. /build/src/Databases/TablesLoader.cpp:57: DB::TablesLoader::loadTablesAsync(std::unordered_set, std::hash>, std::equal_to>, std::allocator>>) @ 0x000000001b02ffba 9. /build/src/Interpreters/InterpreterCreateQuery.cpp:338: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000001b00b2ef 10. /build/src/Interpreters/InterpreterCreateQuery.cpp:1791: DB::InterpreterCreateQuery::execute() @ 0x000000001b02103f 11. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 12. /build/src/Interpreters/executeQuery.cpp:1496: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb4e89 13. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 14. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 2024.12.16 11:34:47.097132 [ 8549 ] {fdb4d478-0c83-473b-8fdd-4cae30c72743} DynamicQueryHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:40102): While executing TabSeparatedRowOutputFormat. (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Processors/Formats/IOutputFormat.cpp:111: DB::IOutputFormat::flush() @ 0x000000001d547b9c 13. /build/src/Processors/Formats/IOutputFormat.cpp:0: DB::IOutputFormat::work() @ 0x000000001d5478f4 14. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 15. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 16. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 17. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 18. /build/src/Processors/Executors/PipelineExecutor.cpp:411: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514ed5 19. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 20. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 21. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 22. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 23. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 24. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 25. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 26. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 27. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 28. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 29. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 30. ? @ 0x00007f713a222ac3 31. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.097116 [ 8504 ] {433fadc3-62e8-4075-9cda-6d12a0dd5c81} DynamicQueryHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:46232): While executing TabSeparatedRowOutputFormat. (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Processors/Formats/IOutputFormat.cpp:111: DB::IOutputFormat::flush() @ 0x000000001d547b9c 13. /build/src/Processors/Formats/IOutputFormat.cpp:0: DB::IOutputFormat::work() @ 0x000000001d5478f4 14. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 15. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 16. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 17. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 18. /build/src/Processors/Executors/PipelineExecutor.cpp:411: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514ed5 19. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 20. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 21. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 22. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 23. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 24. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 25. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 26. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 27. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 28. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 29. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 30. ? @ 0x00007f713a222ac3 31. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.097147 [ 8563 ] {e2fa5b8f-5120-4e93-aa0b-53487d496aea} executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:42834): While executing TabSeparatedRowOutputFormat. (NETWORK_ERROR) (version 24.3.12.76.altinitystable) (from [::1]:42834) (in query: EXISTS TABLE test.hits ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Processors/Formats/IOutputFormat.cpp:111: DB::IOutputFormat::flush() @ 0x000000001d547b9c 13. /build/src/Processors/Formats/IOutputFormat.cpp:0: DB::IOutputFormat::work() @ 0x000000001d5478f4 14. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 15. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 16. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 17. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 18. /build/src/Processors/Executors/PipelineExecutor.cpp:411: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514ed5 19. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 20. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 21. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 22. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 23. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 24. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 25. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 26. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 27. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 28. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 29. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 30. ? @ 0x00007f713a222ac3 31. ? @ 0x00007f713a2b4850 2024.12.16 11:34:47.097276 [ 8544 ] {4a8e9f14-c4f0-4a9f-b727-1bef9208abe9} DynamicQueryHandler: Cannot send exception to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:54992). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/HTTPServerResponse.h:164: DB::HTTPWriteBuffer::nextImplChunked() @ 0x000000001d49ee29 8. /build/src/Server/HTTP/HTTPServerResponse.h:135: DB::HTTPWriteBuffer::nextImpl() @ 0x000000001d49eaef 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:116: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e3bf 10. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 11. /build/src/Server/HTTPHandler.cpp:955: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db57f 12. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 13. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 14. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 15. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 16. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 17. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 18. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 19. ? @ 0x00007f713a222ac3 20. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.097309 [ 8554 ] {f74d532f-84a9-4d57-98cc-036131d97de1} executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:60210): While executing TabSeparatedRowOutputFormat. (NETWORK_ERROR) (version 24.3.12.76.altinitystable) (from [::1]:60210) (in query: EXISTS TABLE test.hits ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Processors/Formats/IOutputFormat.cpp:111: DB::IOutputFormat::flush() @ 0x000000001d547b9c 13. /build/src/Processors/Formats/IOutputFormat.cpp:0: DB::IOutputFormat::work() @ 0x000000001d5478f4 14. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 15. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 16. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 17. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 18. /build/src/Processors/Executors/PipelineExecutor.cpp:411: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514ed5 19. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 20. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 21. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 22. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 23. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 24. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 25. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 26. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 27. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 28. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 29. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 30. ? @ 0x00007f713a222ac3 31. ? @ 0x00007f713a2b4850 2024.12.16 11:34:47.096674 [ 8539 ] {31a73105-8f76-4a1f-acd2-6d1d4ef0c242} executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:60472): While executing TabSeparatedRowOutputFormat. (NETWORK_ERROR) (version 24.3.12.76.altinitystable) (from [::1]:60472) (in query: EXISTS TABLE test.hits ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Processors/Formats/IOutputFormat.cpp:111: DB::IOutputFormat::flush() @ 0x000000001d547b9c 13. /build/src/Processors/Formats/IOutputFormat.cpp:0: DB::IOutputFormat::work() @ 0x000000001d5478f4 14. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 15. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 16. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 17. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 18. /build/src/Processors/Executors/PipelineExecutor.cpp:411: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514ed5 19. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 20. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 21. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 22. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 23. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 24. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 25. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 26. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 27. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 28. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 29. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 30. ? @ 0x00007f713a222ac3 31. ? @ 0x00007f713a2b4850 2024.12.16 11:34:47.096894 [ 8560 ] {46ef63b5-c4b9-401f-9e35-24c4e6bc5915} DynamicQueryHandler: Cannot flush data to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:59136). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:184: DB::WriteBufferFromHTTPServerResponse::finalizeImpl() @ 0x000000001d49e9d2 11. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 12. /build/src/Server/HTTPHandler.h:94: DB::HTTPHandler::Output::finalize() @ 0x000000001d3ea829 13. /build/src/Server/HTTPHandler.cpp:910: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da5ca 14. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.097758 [ 8519 ] {aa9f51a3-84de-4c6d-bad1-e7dddcd16c74} executeQuery: Code: 253. DB::Exception: Replica r1 of shard s1 of replicated database at /test/db/test_14 already exists. Replica host ID: 'ed2a21f3ed57:9000:9c868dce-a0aa-41d2-9491-b3682ddb4e9a', current host ID: 'ed2a21f3ed57:9000:70b9c93f-8a29-4001-b899-afb9d05f236d'. (REPLICA_ALREADY_EXISTS) (version 24.3.12.76.altinitystable) (from [::1]:56288) (comment: 01076_range_reader_segfault.sql) (in query: CREATE DATABASE IF NOT EXISTS test_ewqhd64b ENGINE=Replicated('/test/db/test_14', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, String&, String&, String&, String&, String&) @ 0x000000001a1115da 6. /build/src/Databases/DatabaseReplicated.cpp:375: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000001a0ed3e9 7. /build/src/Databases/DatabaseReplicated.cpp:543: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000001a0f0271 8. /build/src/Databases/TablesLoader.cpp:57: DB::TablesLoader::loadTablesAsync(std::unordered_set, std::hash>, std::equal_to>, std::allocator>>) @ 0x000000001b02ffba 9. /build/src/Interpreters/InterpreterCreateQuery.cpp:338: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000001b00b2ef 10. /build/src/Interpreters/InterpreterCreateQuery.cpp:1791: DB::InterpreterCreateQuery::execute() @ 0x000000001b02103f 11. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 12. /build/src/Interpreters/executeQuery.cpp:1496: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb4e89 13. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 14. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 2024.12.16 11:34:47.298033 [ 8513 ] {b90e7b5b-f4c8-4c48-b014-76ef34485ca2} DynamicQueryHandler: Cannot send exception to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:45268). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Server/HTTPHandler.cpp:955: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db57f 13. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 14. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 20. ? @ 0x00007f713a222ac3 21. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.298088 [ 8543 ] {bc6e40fb-6d11-4b3e-b5ca-f58afe01a76d} DynamicQueryHandler: Cannot send exception to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:54990). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/HTTPServerResponse.h:164: DB::HTTPWriteBuffer::nextImplChunked() @ 0x000000001d49ee29 8. /build/src/Server/HTTP/HTTPServerResponse.h:135: DB::HTTPWriteBuffer::nextImpl() @ 0x000000001d49eaef 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:116: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e3bf 10. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 11. /build/src/Server/HTTPHandler.cpp:955: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db57f 12. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 13. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 14. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 15. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 16. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 17. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 18. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 19. ? @ 0x00007f713a222ac3 20. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.298165 [ 8511 ] {f23f989b-f9c1-47bb-9728-d03bc28b30ef} DynamicQueryHandler: Code: 253. DB::Exception: Replica r1 of shard s1 of replicated database at /test/db/test_14 already exists. Replica host ID: 'ed2a21f3ed57:9000:9c868dce-a0aa-41d2-9491-b3682ddb4e9a', current host ID: 'ed2a21f3ed57:9000:a222f5d1-128e-47fc-829b-d4fb8d957bbd'. (REPLICA_ALREADY_EXISTS), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, String&, String&, String&, String&, String&) @ 0x000000001a1115da 6. /build/src/Databases/DatabaseReplicated.cpp:375: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000001a0ed3e9 7. /build/src/Databases/DatabaseReplicated.cpp:543: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000001a0f0271 8. /build/src/Databases/TablesLoader.cpp:57: DB::TablesLoader::loadTablesAsync(std::unordered_set, std::hash>, std::equal_to>, std::allocator>>) @ 0x000000001b02ffba 9. /build/src/Interpreters/InterpreterCreateQuery.cpp:338: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000001b00b2ef 10. /build/src/Interpreters/InterpreterCreateQuery.cpp:1791: DB::InterpreterCreateQuery::execute() @ 0x000000001b02103f 11. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 12. /build/src/Interpreters/executeQuery.cpp:1496: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb4e89 13. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 14. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.298204 [ 3492 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {3874c721-a658-4698-80d5-52c26fc35278::202412_1_70_14}: Code: 241. DB::Exception: Memory tracker (for thread): fault injected (at specific point). (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, char const*&&) @ 0x00000000132eab6c 6. /build/src/Common/MemoryTracker.cpp:184: MemoryTracker::injectFault() const @ 0x00000000132e7f5f 7. /build/src/Common/CurrentMemoryTracker.cpp:129: CurrentMemoryTracker::injectFault() @ 0x0000000013256b05 8. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:149: DB::MergePlainMergeTreeTask::finish() @ 0x000000001d13f918 9. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:71: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13f076 10. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x000000001cba15ed 11. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x000000001cba210e 12. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef, StrongTypedef, std::basic_string_view>)::'lambda'()::operator()() const @ 0x000000001cba9c78 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba9c55 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001cba9c35 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001cba9c15 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001cba9bdd 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.298074 [ 8564 ] {78b31664-ace5-4e91-a4d8-a8b1cbf7c738} executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:57948): While executing TabSeparatedRowOutputFormat. (NETWORK_ERROR) (version 24.3.12.76.altinitystable) (from [::1]:57948) (in query: EXISTS TABLE test.hits ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Processors/Formats/IOutputFormat.cpp:111: DB::IOutputFormat::flush() @ 0x000000001d547b9c 13. /build/src/Processors/Formats/IOutputFormat.cpp:0: DB::IOutputFormat::work() @ 0x000000001d5478f4 14. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 15. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 16. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 17. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 18. /build/src/Processors/Executors/PipelineExecutor.cpp:411: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514ed5 19. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 20. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 21. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 22. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 23. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 24. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 25. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 26. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 27. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 28. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 29. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 30. ? @ 0x00007f713a222ac3 31. ? @ 0x00007f713a2b4850 2024.12.16 11:34:47.298289 [ 8524 ] {424fa945-4d36-4fc9-893c-372e43965ea0} DynamicQueryHandler: Code: 999. Coordination::Exception: Coordination error: Session expired, path /test/db/test_14. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, String const&) @ 0x0000000018fcc42c 6. /build/src/Common/ZooKeeper/IKeeper.h:488: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, String const&) @ 0x0000000018fcc27d 7. /build/src/Common/ZooKeeper/IKeeper.h:501: Coordination::Exception::fromPath(Coordination::Error, String const&) @ 0x0000000018fc990c 8. /build/src/Common/ZooKeeper/ZooKeeper.cpp:517: zkutil::ZooKeeper::existsWatch(String const&, Coordination::Stat*, std::function) @ 0x000000001e1b3633 9. /build/src/Common/ZooKeeper/ZooKeeper.cpp:498: zkutil::ZooKeeper::exists(String const&, Coordination::Stat*, std::shared_ptr const&) @ 0x000000001e1b13f6 10. /build/src/Databases/DatabaseReplicated.cpp:352: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000001a0ec616 11. /build/src/Databases/DatabaseReplicated.cpp:543: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000001a0f0271 12. /build/src/Databases/TablesLoader.cpp:57: DB::TablesLoader::loadTablesAsync(std::unordered_set, std::hash>, std::equal_to>, std::allocator>>) @ 0x000000001b02ffba 13. /build/src/Interpreters/InterpreterCreateQuery.cpp:338: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000001b00b2ef 14. /build/src/Interpreters/InterpreterCreateQuery.cpp:1791: DB::InterpreterCreateQuery::execute() @ 0x000000001b02103f 15. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 16. /build/src/Interpreters/executeQuery.cpp:1496: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb4e89 17. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 18. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 19. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 20. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 21. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 22. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 23. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 24. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 25. ? @ 0x00007f713a222ac3 26. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.298424 [ 8508 ] {e908df23-54cf-4935-857b-2e4d9e700835} DynamicQueryHandler: Cannot send exception to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:59176). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/HTTPServerResponse.h:164: DB::HTTPWriteBuffer::nextImplChunked() @ 0x000000001d49ee29 8. /build/src/Server/HTTP/HTTPServerResponse.h:135: DB::HTTPWriteBuffer::nextImpl() @ 0x000000001d49eaef 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:116: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e3bf 10. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 11. /build/src/Server/HTTPHandler.cpp:955: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db57f 12. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 13. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 14. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 15. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 16. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 17. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 18. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 19. ? @ 0x00007f713a222ac3 20. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.298478 [ 8522 ] {2f5f9f60-72d7-4c7c-ac18-eea556b3cf09} DynamicQueryHandler: Code: 253. DB::Exception: Replica r1 of shard s1 of replicated database at /test/db/test_14 already exists. Replica host ID: 'ed2a21f3ed57:9000:9c868dce-a0aa-41d2-9491-b3682ddb4e9a', current host ID: 'ed2a21f3ed57:9000:d6beee50-362b-464f-a4c9-7807f6aab4fb'. (REPLICA_ALREADY_EXISTS), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, String&, String&, String&, String&, String&) @ 0x000000001a1115da 6. /build/src/Databases/DatabaseReplicated.cpp:375: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000001a0ed3e9 7. /build/src/Databases/DatabaseReplicated.cpp:543: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000001a0f0271 8. /build/src/Databases/TablesLoader.cpp:57: DB::TablesLoader::loadTablesAsync(std::unordered_set, std::hash>, std::equal_to>, std::allocator>>) @ 0x000000001b02ffba 9. /build/src/Interpreters/InterpreterCreateQuery.cpp:338: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000001b00b2ef 10. /build/src/Interpreters/InterpreterCreateQuery.cpp:1791: DB::InterpreterCreateQuery::execute() @ 0x000000001b02103f 11. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 12. /build/src/Interpreters/executeQuery.cpp:1496: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb4e89 13. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 14. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.298715 [ 8513 ] {b90e7b5b-f4c8-4c48-b014-76ef34485ca2} DynamicQueryHandler: Cannot flush data to client (after sending exception): Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:45268). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:184: DB::WriteBufferFromHTTPServerResponse::finalizeImpl() @ 0x000000001d49e9d2 11. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 12. /build/src/Server/HTTPHandler.h:94: DB::HTTPHandler::Output::finalize() @ 0x000000001d3ea829 13. /build/src/Server/HTTPHandler.cpp:970: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db33a 14. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.298196 [ 8545 ] {d632a811-8cb8-4d1b-8e29-eed0a9f0a17b} DynamicQueryHandler: Cannot send exception to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:57338). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/HTTPServerResponse.h:164: DB::HTTPWriteBuffer::nextImplChunked() @ 0x000000001d49ee29 8. /build/src/Server/HTTP/HTTPServerResponse.h:135: DB::HTTPWriteBuffer::nextImpl() @ 0x000000001d49eaef 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:116: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e3bf 10. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 11. /build/src/Server/HTTPHandler.cpp:955: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db57f 12. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 13. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 14. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 15. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 16. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 17. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 18. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 19. ? @ 0x00007f713a222ac3 20. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.299089 [ 8526 ] {37cf0e5e-5312-41c3-93fa-751a8ccd7ef0} DynamicQueryHandler: Cannot flush data to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:56862). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:184: DB::WriteBufferFromHTTPServerResponse::finalizeImpl() @ 0x000000001d49e9d2 11. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 12. /build/src/Server/HTTPHandler.h:94: DB::HTTPHandler::Output::finalize() @ 0x000000001d3ea829 13. /build/src/Server/HTTPHandler.cpp:910: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da5ca 14. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.299159 [ 8534 ] {01469960-746b-47fa-8ac1-6af483888fcb} DynamicQueryHandler: Cannot flush data to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:40008). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:184: DB::WriteBufferFromHTTPServerResponse::finalizeImpl() @ 0x000000001d49e9d2 11. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 12. /build/src/Server/HTTPHandler.h:94: DB::HTTPHandler::Output::finalize() @ 0x000000001d3ea829 13. /build/src/Server/HTTPHandler.cpp:910: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da5ca 14. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.299193 [ 8527 ] {59452293-9205-4bed-9537-ea665a2d9769} DynamicQueryHandler: Cannot flush data to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:41924). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:184: DB::WriteBufferFromHTTPServerResponse::finalizeImpl() @ 0x000000001d49e9d2 11. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 12. /build/src/Server/HTTPHandler.h:94: DB::HTTPHandler::Output::finalize() @ 0x000000001d3ea829 13. /build/src/Server/HTTPHandler.cpp:910: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da5ca 14. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.299364 [ 3751 ] {adca9650-9745-4d5d-8071-b92a33e45553} DynamicQueryHandler: Cannot flush data to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:60448). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:184: DB::WriteBufferFromHTTPServerResponse::finalizeImpl() @ 0x000000001d49e9d2 11. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 12. /build/src/Server/HTTPHandler.h:94: DB::HTTPHandler::Output::finalize() @ 0x000000001d3ea829 13. /build/src/Server/HTTPHandler.cpp:910: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da5ca 14. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.299671 [ 8545 ] {d632a811-8cb8-4d1b-8e29-eed0a9f0a17b} DynamicQueryHandler: Cannot flush data to client (after sending exception): Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:57338). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:184: DB::WriteBufferFromHTTPServerResponse::finalizeImpl() @ 0x000000001d49e9d2 11. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 12. /build/src/Server/HTTPHandler.h:94: DB::HTTPHandler::Output::finalize() @ 0x000000001d3ea829 13. /build/src/Server/HTTPHandler.cpp:970: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db33a 14. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.299724 [ 8522 ] {2f5f9f60-72d7-4c7c-ac18-eea556b3cf09} DynamicQueryHandler: Cannot send exception to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:42346). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Server/HTTPHandler.cpp:955: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db57f 13. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 14. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 20. ? @ 0x00007f713a222ac3 21. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.299994 [ 8511 ] {f23f989b-f9c1-47bb-9728-d03bc28b30ef} DynamicQueryHandler: Cannot send exception to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:53758). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Server/HTTPHandler.cpp:955: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db57f 13. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 14. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 20. ? @ 0x00007f713a222ac3 21. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.300058 [ 8564 ] {78b31664-ace5-4e91-a4d8-a8b1cbf7c738} DynamicQueryHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:57948): While executing TabSeparatedRowOutputFormat. (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Processors/Formats/IOutputFormat.cpp:111: DB::IOutputFormat::flush() @ 0x000000001d547b9c 13. /build/src/Processors/Formats/IOutputFormat.cpp:0: DB::IOutputFormat::work() @ 0x000000001d5478f4 14. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 15. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 16. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 17. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 18. /build/src/Processors/Executors/PipelineExecutor.cpp:411: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514ed5 19. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 20. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 21. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 22. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 23. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 24. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 25. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 26. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 27. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 28. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 29. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 30. ? @ 0x00007f713a222ac3 31. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.300578 [ 8522 ] {2f5f9f60-72d7-4c7c-ac18-eea556b3cf09} DynamicQueryHandler: Cannot flush data to client (after sending exception): Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:42346). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:184: DB::WriteBufferFromHTTPServerResponse::finalizeImpl() @ 0x000000001d49e9d2 11. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 12. /build/src/Server/HTTPHandler.h:94: DB::HTTPHandler::Output::finalize() @ 0x000000001d3ea829 13. /build/src/Server/HTTPHandler.cpp:970: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db33a 14. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.300701 [ 8531 ] {bdb39297-c051-4b0c-bb71-aa3fea262176} DynamicQueryHandler: Cannot flush data to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:59920). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:184: DB::WriteBufferFromHTTPServerResponse::finalizeImpl() @ 0x000000001d49e9d2 11. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 12. /build/src/Server/HTTPHandler.h:94: DB::HTTPHandler::Output::finalize() @ 0x000000001d3ea829 13. /build/src/Server/HTTPHandler.cpp:910: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da5ca 14. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.300735 [ 8530 ] {8afb4826-0dd0-4cbe-8f8d-c335c7068a41} DynamicQueryHandler: Code: 253. DB::Exception: Replica r1 of shard s1 of replicated database at /test/db/test_14 already exists. Replica host ID: 'ed2a21f3ed57:9000:9c868dce-a0aa-41d2-9491-b3682ddb4e9a', current host ID: 'ed2a21f3ed57:9000:373eb6f4-8ded-4880-a0ca-32b71d9be05e'. (REPLICA_ALREADY_EXISTS), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, String&, String&, String&, String&, String&) @ 0x000000001a1115da 6. /build/src/Databases/DatabaseReplicated.cpp:375: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000001a0ed3e9 7. /build/src/Databases/DatabaseReplicated.cpp:543: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000001a0f0271 8. /build/src/Databases/TablesLoader.cpp:57: DB::TablesLoader::loadTablesAsync(std::unordered_set, std::hash>, std::equal_to>, std::allocator>>) @ 0x000000001b02ffba 9. /build/src/Interpreters/InterpreterCreateQuery.cpp:338: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000001b00b2ef 10. /build/src/Interpreters/InterpreterCreateQuery.cpp:1791: DB::InterpreterCreateQuery::execute() @ 0x000000001b02103f 11. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 12. /build/src/Interpreters/executeQuery.cpp:1496: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb4e89 13. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 14. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.300772 [ 8505 ] {48d516d7-4f35-4ebf-89f8-0cf1723cb219} DynamicQueryHandler: Cannot flush data to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:43454). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:184: DB::WriteBufferFromHTTPServerResponse::finalizeImpl() @ 0x000000001d49e9d2 11. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 12. /build/src/Server/HTTPHandler.h:94: DB::HTTPHandler::Output::finalize() @ 0x000000001d3ea829 13. /build/src/Server/HTTPHandler.cpp:910: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da5ca 14. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.300819 [ 8507 ] {48cf3d2c-d293-4618-8eb7-92a04b5b3e50} DynamicQueryHandler: Cannot flush data to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:53938). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:184: DB::WriteBufferFromHTTPServerResponse::finalizeImpl() @ 0x000000001d49e9d2 11. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 12. /build/src/Server/HTTPHandler.h:94: DB::HTTPHandler::Output::finalize() @ 0x000000001d3ea829 13. /build/src/Server/HTTPHandler.cpp:910: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da5ca 14. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.300790 [ 2758 ] {ffc25f4e-7b65-4387-bb12-beb3ac374e39} DynamicQueryHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:51622): While executing TabSeparatedRowOutputFormat. (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Processors/Formats/IOutputFormat.cpp:111: DB::IOutputFormat::flush() @ 0x000000001d547b9c 13. /build/src/Processors/Formats/IOutputFormat.cpp:0: DB::IOutputFormat::work() @ 0x000000001d5478f4 14. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 15. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 16. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 17. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 18. /build/src/Processors/Executors/PipelineExecutor.cpp:411: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514ed5 19. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 20. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 21. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 22. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 23. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 24. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 25. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 26. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 27. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 28. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 29. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 30. ? @ 0x00007f713a222ac3 31. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.300815 [ 8523 ] {a2f55439-637e-4f14-94f3-a591ccb01889} DynamicQueryHandler: Code: 253. DB::Exception: Replica r1 of shard s1 of replicated database at /test/db/test_14 already exists. Replica host ID: 'ed2a21f3ed57:9000:9c868dce-a0aa-41d2-9491-b3682ddb4e9a', current host ID: 'ed2a21f3ed57:9000:47d4db15-d073-45e9-9f3d-66abb4f27d46'. (REPLICA_ALREADY_EXISTS), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, String&, String&, String&, String&, String&) @ 0x000000001a1115da 6. /build/src/Databases/DatabaseReplicated.cpp:375: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000001a0ed3e9 7. /build/src/Databases/DatabaseReplicated.cpp:543: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000001a0f0271 8. /build/src/Databases/TablesLoader.cpp:57: DB::TablesLoader::loadTablesAsync(std::unordered_set, std::hash>, std::equal_to>, std::allocator>>) @ 0x000000001b02ffba 9. /build/src/Interpreters/InterpreterCreateQuery.cpp:338: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000001b00b2ef 10. /build/src/Interpreters/InterpreterCreateQuery.cpp:1791: DB::InterpreterCreateQuery::execute() @ 0x000000001b02103f 11. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 12. /build/src/Interpreters/executeQuery.cpp:1496: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb4e89 13. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 14. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.301177 [ 8564 ] {78b31664-ace5-4e91-a4d8-a8b1cbf7c738} DynamicQueryHandler: Cannot send exception to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:57948). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/HTTPServerResponse.h:164: DB::HTTPWriteBuffer::nextImplChunked() @ 0x000000001d49ee29 8. /build/src/Server/HTTP/HTTPServerResponse.h:135: DB::HTTPWriteBuffer::nextImpl() @ 0x000000001d49eaef 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:116: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e3bf 10. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 11. /build/src/Server/HTTPHandler.cpp:955: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db57f 12. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 13. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 14. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 15. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 16. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 17. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 18. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 19. ? @ 0x00007f713a222ac3 20. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.301147 [ 8556 ] {2b56d17a-23ed-49db-89ea-5b9b7780d8e1} executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:34658): While executing TabSeparatedRowOutputFormat. (NETWORK_ERROR) (version 24.3.12.76.altinitystable) (from [::1]:34658) (in query: EXISTS TABLE test.hits ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Processors/Formats/IOutputFormat.cpp:111: DB::IOutputFormat::flush() @ 0x000000001d547b9c 13. /build/src/Processors/Formats/IOutputFormat.cpp:0: DB::IOutputFormat::work() @ 0x000000001d5478f4 14. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 15. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 16. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 17. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 18. /build/src/Processors/Executors/PipelineExecutor.cpp:411: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514ed5 19. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 20. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 21. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 22. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 23. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 24. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 25. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 26. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 27. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 28. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 29. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 30. ? @ 0x00007f713a222ac3 31. ? @ 0x00007f713a2b4850 2024.12.16 11:34:47.301154 [ 8557 ] {d4fdcca1-7808-4290-9284-11eeb7e88336} executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:51974): While executing TabSeparatedRowOutputFormat. (NETWORK_ERROR) (version 24.3.12.76.altinitystable) (from [::1]:51974) (in query: EXISTS TABLE test.hits ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Processors/Formats/IOutputFormat.cpp:111: DB::IOutputFormat::flush() @ 0x000000001d547b9c 13. /build/src/Processors/Formats/IOutputFormat.cpp:0: DB::IOutputFormat::work() @ 0x000000001d5478f4 14. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 15. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 16. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 17. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 18. /build/src/Processors/Executors/PipelineExecutor.cpp:411: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514ed5 19. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 20. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 21. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 22. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 23. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 24. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 25. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 26. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 27. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 28. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 29. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 30. ? @ 0x00007f713a222ac3 31. ? @ 0x00007f713a2b4850 2024.12.16 11:34:47.301674 [ 8530 ] {8afb4826-0dd0-4cbe-8f8d-c335c7068a41} DynamicQueryHandler: Cannot send exception to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:59922). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Server/HTTPHandler.cpp:955: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db57f 13. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 14. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 20. ? @ 0x00007f713a222ac3 21. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.301704 [ 2758 ] {ffc25f4e-7b65-4387-bb12-beb3ac374e39} DynamicQueryHandler: Cannot send exception to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:51622). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/HTTPServerResponse.h:164: DB::HTTPWriteBuffer::nextImplChunked() @ 0x000000001d49ee29 8. /build/src/Server/HTTP/HTTPServerResponse.h:135: DB::HTTPWriteBuffer::nextImpl() @ 0x000000001d49eaef 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:116: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e3bf 10. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 11. /build/src/Server/HTTPHandler.cpp:955: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db57f 12. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 13. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 14. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 15. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 16. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 17. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 18. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 19. ? @ 0x00007f713a222ac3 20. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.302069 [ 8523 ] {a2f55439-637e-4f14-94f3-a591ccb01889} DynamicQueryHandler: Cannot send exception to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:47898). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Server/HTTPHandler.cpp:955: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db57f 13. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 14. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 20. ? @ 0x00007f713a222ac3 21. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.302136 [ 8564 ] {78b31664-ace5-4e91-a4d8-a8b1cbf7c738} DynamicQueryHandler: Cannot flush data to client (after sending exception): Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:57948). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:184: DB::WriteBufferFromHTTPServerResponse::finalizeImpl() @ 0x000000001d49e9d2 11. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 12. /build/src/Server/HTTPHandler.h:94: DB::HTTPHandler::Output::finalize() @ 0x000000001d3ea829 13. /build/src/Server/HTTPHandler.cpp:970: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db33a 14. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.302326 [ 8530 ] {8afb4826-0dd0-4cbe-8f8d-c335c7068a41} DynamicQueryHandler: Cannot flush data to client (after sending exception): Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:59922). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:184: DB::WriteBufferFromHTTPServerResponse::finalizeImpl() @ 0x000000001d49e9d2 11. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 12. /build/src/Server/HTTPHandler.h:94: DB::HTTPHandler::Output::finalize() @ 0x000000001d3ea829 13. /build/src/Server/HTTPHandler.cpp:970: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db33a 14. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.302386 [ 2758 ] {ffc25f4e-7b65-4387-bb12-beb3ac374e39} DynamicQueryHandler: Cannot flush data to client (after sending exception): Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:51622). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:184: DB::WriteBufferFromHTTPServerResponse::finalizeImpl() @ 0x000000001d49e9d2 11. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 12. /build/src/Server/HTTPHandler.h:94: DB::HTTPHandler::Output::finalize() @ 0x000000001d3ea829 13. /build/src/Server/HTTPHandler.cpp:970: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db33a 14. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.302402 [ 8556 ] {2b56d17a-23ed-49db-89ea-5b9b7780d8e1} DynamicQueryHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:34658): While executing TabSeparatedRowOutputFormat. (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Processors/Formats/IOutputFormat.cpp:111: DB::IOutputFormat::flush() @ 0x000000001d547b9c 13. /build/src/Processors/Formats/IOutputFormat.cpp:0: DB::IOutputFormat::work() @ 0x000000001d5478f4 14. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 15. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 16. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 17. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 18. /build/src/Processors/Executors/PipelineExecutor.cpp:411: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514ed5 19. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 20. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 21. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 22. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 23. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 24. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 25. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 26. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 27. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 28. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 29. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 30. ? @ 0x00007f713a222ac3 31. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.302773 [ 8557 ] {d4fdcca1-7808-4290-9284-11eeb7e88336} DynamicQueryHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:51974): While executing TabSeparatedRowOutputFormat. (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Processors/Formats/IOutputFormat.cpp:111: DB::IOutputFormat::flush() @ 0x000000001d547b9c 13. /build/src/Processors/Formats/IOutputFormat.cpp:0: DB::IOutputFormat::work() @ 0x000000001d5478f4 14. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 15. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 16. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 17. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 18. /build/src/Processors/Executors/PipelineExecutor.cpp:411: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514ed5 19. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 20. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 21. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 22. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 23. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 24. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 25. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 26. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 27. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 28. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 29. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 30. ? @ 0x00007f713a222ac3 31. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.303002 [ 8523 ] {a2f55439-637e-4f14-94f3-a591ccb01889} DynamicQueryHandler: Cannot flush data to client (after sending exception): Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:47898). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:184: DB::WriteBufferFromHTTPServerResponse::finalizeImpl() @ 0x000000001d49e9d2 11. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 12. /build/src/Server/HTTPHandler.h:94: DB::HTTPHandler::Output::finalize() @ 0x000000001d3ea829 13. /build/src/Server/HTTPHandler.cpp:970: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db33a 14. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.303153 [ 8556 ] {2b56d17a-23ed-49db-89ea-5b9b7780d8e1} DynamicQueryHandler: Cannot send exception to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:34658). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/HTTPServerResponse.h:164: DB::HTTPWriteBuffer::nextImplChunked() @ 0x000000001d49ee29 8. /build/src/Server/HTTP/HTTPServerResponse.h:135: DB::HTTPWriteBuffer::nextImpl() @ 0x000000001d49eaef 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:116: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e3bf 10. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 11. /build/src/Server/HTTPHandler.cpp:955: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db57f 12. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 13. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 14. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 15. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 16. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 17. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 18. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 19. ? @ 0x00007f713a222ac3 20. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.303416 [ 8518 ] {fb7d7adf-eda4-4dd2-8fcf-344c437f32ec} DynamicQueryHandler: Code: 253. DB::Exception: Replica r1 of shard s1 of replicated database at /test/db/test_14 already exists. Replica host ID: 'ed2a21f3ed57:9000:9c868dce-a0aa-41d2-9491-b3682ddb4e9a', current host ID: 'ed2a21f3ed57:9000:a8d4a398-e372-46e8-85fd-5b572198a644'. (REPLICA_ALREADY_EXISTS), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, String&, String&, String&, String&, String&) @ 0x000000001a1115da 6. /build/src/Databases/DatabaseReplicated.cpp:375: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000001a0ed3e9 7. /build/src/Databases/DatabaseReplicated.cpp:543: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000001a0f0271 8. /build/src/Databases/TablesLoader.cpp:57: DB::TablesLoader::loadTablesAsync(std::unordered_set, std::hash>, std::equal_to>, std::allocator>>) @ 0x000000001b02ffba 9. /build/src/Interpreters/InterpreterCreateQuery.cpp:338: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000001b00b2ef 10. /build/src/Interpreters/InterpreterCreateQuery.cpp:1791: DB::InterpreterCreateQuery::execute() @ 0x000000001b02103f 11. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 12. /build/src/Interpreters/executeQuery.cpp:1496: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb4e89 13. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 14. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.303686 [ 8566 ] {dc010b52-3f34-4216-9397-60119e3385a3} executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:37216): While executing TabSeparatedRowOutputFormat. (NETWORK_ERROR) (version 24.3.12.76.altinitystable) (from [::1]:37216) (in query: EXISTS TABLE test.hits ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Processors/Formats/IOutputFormat.cpp:111: DB::IOutputFormat::flush() @ 0x000000001d547b9c 13. /build/src/Processors/Formats/IOutputFormat.cpp:0: DB::IOutputFormat::work() @ 0x000000001d5478f4 14. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 15. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 16. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 17. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 18. /build/src/Processors/Executors/PipelineExecutor.cpp:411: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514ed5 19. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 20. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 21. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 22. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 23. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 24. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 25. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 26. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 27. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 28. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 29. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 30. ? @ 0x00007f713a222ac3 31. ? @ 0x00007f713a2b4850 2024.12.16 11:34:47.303719 [ 8565 ] {040e42ac-62b5-45b9-8df2-f11a4c69e655} executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:38390): While executing TabSeparatedRowOutputFormat. (NETWORK_ERROR) (version 24.3.12.76.altinitystable) (from [::1]:38390) (in query: EXISTS TABLE test.hits ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Processors/Formats/IOutputFormat.cpp:111: DB::IOutputFormat::flush() @ 0x000000001d547b9c 13. /build/src/Processors/Formats/IOutputFormat.cpp:0: DB::IOutputFormat::work() @ 0x000000001d5478f4 14. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 15. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 16. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 17. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 18. /build/src/Processors/Executors/PipelineExecutor.cpp:411: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514ed5 19. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 20. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 21. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 22. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 23. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 24. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 25. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 26. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 27. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 28. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 29. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 30. ? @ 0x00007f713a222ac3 31. ? @ 0x00007f713a2b4850 2024.12.16 11:34:47.304083 [ 8541 ] {c1fe79d5-1d2b-4203-87db-5a90d25355bd} DynamicQueryHandler: Cannot send exception to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:35656). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/HTTPServerResponse.h:164: DB::HTTPWriteBuffer::nextImplChunked() @ 0x000000001d49ee29 8. /build/src/Server/HTTP/HTTPServerResponse.h:135: DB::HTTPWriteBuffer::nextImpl() @ 0x000000001d49eaef 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:116: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e3bf 10. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 11. /build/src/Server/HTTPHandler.cpp:955: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db57f 12. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 13. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 14. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 15. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 16. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 17. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 18. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 19. ? @ 0x00007f713a222ac3 20. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.304168 [ 8512 ] {38736ac8-fda5-490d-8faf-03c19e915abd} DynamicQueryHandler: Cannot send exception to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:40852). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/HTTPServerResponse.h:164: DB::HTTPWriteBuffer::nextImplChunked() @ 0x000000001d49ee29 8. /build/src/Server/HTTP/HTTPServerResponse.h:135: DB::HTTPWriteBuffer::nextImpl() @ 0x000000001d49eaef 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:116: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e3bf 10. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 11. /build/src/Server/HTTPHandler.cpp:955: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db57f 12. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 13. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 14. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 15. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 16. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 17. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 18. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 19. ? @ 0x00007f713a222ac3 20. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.304759 [ 8518 ] {fb7d7adf-eda4-4dd2-8fcf-344c437f32ec} DynamicQueryHandler: Cannot send exception to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:57052). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Server/HTTPHandler.cpp:955: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db57f 13. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 14. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 20. ? @ 0x00007f713a222ac3 21. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.304962 [ 8566 ] {dc010b52-3f34-4216-9397-60119e3385a3} DynamicQueryHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:37216): While executing TabSeparatedRowOutputFormat. (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Processors/Formats/IOutputFormat.cpp:111: DB::IOutputFormat::flush() @ 0x000000001d547b9c 13. /build/src/Processors/Formats/IOutputFormat.cpp:0: DB::IOutputFormat::work() @ 0x000000001d5478f4 14. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 15. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 16. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 17. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 18. /build/src/Processors/Executors/PipelineExecutor.cpp:411: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514ed5 19. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 20. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 21. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 22. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 23. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 24. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 25. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 26. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 27. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 28. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 29. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 30. ? @ 0x00007f713a222ac3 31. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.305005 [ 8565 ] {040e42ac-62b5-45b9-8df2-f11a4c69e655} DynamicQueryHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:38390): While executing TabSeparatedRowOutputFormat. (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Processors/Formats/IOutputFormat.cpp:111: DB::IOutputFormat::flush() @ 0x000000001d547b9c 13. /build/src/Processors/Formats/IOutputFormat.cpp:0: DB::IOutputFormat::work() @ 0x000000001d5478f4 14. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 15. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 16. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 17. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 18. /build/src/Processors/Executors/PipelineExecutor.cpp:411: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514ed5 19. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 20. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 21. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 22. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 23. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 24. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 25. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 26. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 27. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 28. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 29. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 30. ? @ 0x00007f713a222ac3 31. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.304975 [ 4182 ] {9c0cf181-2953-4869-9670-d68809ed0e20} TCPHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:9000 -> [::1]:53020). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:169: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000134e8a44 7. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 8. /build/src/Server/TCPHandler.cpp:1246: DB::TCPHandler::sendProfileEvents() @ 0x000000001d4802b9 9. /build/src/Server/TCPHandler.cpp:1256: DB::TCPHandler::sendSelectProfileEvents() @ 0x000000001d47b3f4 10. /build/src/Server/TCPHandler.cpp:579: DB::TCPHandler::runImpl() @ 0x000000001d470211 11. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 12. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 13. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 14. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 15. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 16. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 17. ? @ 0x00007f713a222ac3 18. ? @ 0x00007f713a2b4850 2024.12.16 11:34:47.305033 [ 8541 ] {c1fe79d5-1d2b-4203-87db-5a90d25355bd} DynamicQueryHandler: Cannot flush data to client (after sending exception): Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:35656). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:184: DB::WriteBufferFromHTTPServerResponse::finalizeImpl() @ 0x000000001d49e9d2 11. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 12. /build/src/Server/HTTPHandler.h:94: DB::HTTPHandler::Output::finalize() @ 0x000000001d3ea829 13. /build/src/Server/HTTPHandler.cpp:970: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db33a 14. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.305689 [ 8566 ] {dc010b52-3f34-4216-9397-60119e3385a3} DynamicQueryHandler: Cannot send exception to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:37216). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/HTTPServerResponse.h:164: DB::HTTPWriteBuffer::nextImplChunked() @ 0x000000001d49ee29 8. /build/src/Server/HTTP/HTTPServerResponse.h:135: DB::HTTPWriteBuffer::nextImpl() @ 0x000000001d49eaef 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:116: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e3bf 10. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 11. /build/src/Server/HTTPHandler.cpp:955: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db57f 12. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 13. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 14. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 15. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 16. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 17. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 18. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 19. ? @ 0x00007f713a222ac3 20. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.305712 [ 8565 ] {040e42ac-62b5-45b9-8df2-f11a4c69e655} DynamicQueryHandler: Cannot send exception to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:38390). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/HTTPServerResponse.h:164: DB::HTTPWriteBuffer::nextImplChunked() @ 0x000000001d49ee29 8. /build/src/Server/HTTP/HTTPServerResponse.h:135: DB::HTTPWriteBuffer::nextImpl() @ 0x000000001d49eaef 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:116: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e3bf 10. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 11. /build/src/Server/HTTPHandler.cpp:955: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db57f 12. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 13. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 14. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 15. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 16. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 17. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 18. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 19. ? @ 0x00007f713a222ac3 20. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.305709 [ 8518 ] {fb7d7adf-eda4-4dd2-8fcf-344c437f32ec} DynamicQueryHandler: Cannot flush data to client (after sending exception): Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:57052). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:184: DB::WriteBufferFromHTTPServerResponse::finalizeImpl() @ 0x000000001d49e9d2 11. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 12. /build/src/Server/HTTPHandler.h:94: DB::HTTPHandler::Output::finalize() @ 0x000000001d3ea829 13. /build/src/Server/HTTPHandler.cpp:970: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db33a 14. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.305844 [ 4182 ] {9c0cf181-2953-4869-9670-d68809ed0e20} TCPHandler: Client has gone away. 2024.12.16 11:34:47.306315 [ 8565 ] {040e42ac-62b5-45b9-8df2-f11a4c69e655} DynamicQueryHandler: Cannot flush data to client (after sending exception): Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:38390). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:184: DB::WriteBufferFromHTTPServerResponse::finalizeImpl() @ 0x000000001d49e9d2 11. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 12. /build/src/Server/HTTPHandler.h:94: DB::HTTPHandler::Output::finalize() @ 0x000000001d3ea829 13. /build/src/Server/HTTPHandler.cpp:970: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db33a 14. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.303823 [ 8557 ] {d4fdcca1-7808-4290-9284-11eeb7e88336} DynamicQueryHandler: Cannot send exception to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:51974). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/HTTPServerResponse.h:164: DB::HTTPWriteBuffer::nextImplChunked() @ 0x000000001d49ee29 8. /build/src/Server/HTTP/HTTPServerResponse.h:135: DB::HTTPWriteBuffer::nextImpl() @ 0x000000001d49eaef 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:116: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e3bf 10. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 11. /build/src/Server/HTTPHandler.cpp:955: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db57f 12. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 13. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 14. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 15. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 16. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 17. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 18. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 19. ? @ 0x00007f713a222ac3 20. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.306464 [ 8566 ] {dc010b52-3f34-4216-9397-60119e3385a3} DynamicQueryHandler: Cannot flush data to client (after sending exception): Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:37216). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:184: DB::WriteBufferFromHTTPServerResponse::finalizeImpl() @ 0x000000001d49e9d2 11. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 12. /build/src/Server/HTTPHandler.h:94: DB::HTTPHandler::Output::finalize() @ 0x000000001d3ea829 13. /build/src/Server/HTTPHandler.cpp:970: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db33a 14. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.307014 [ 8548 ] {f94706f2-d862-4674-bab0-2f45cb82e64b} executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:40090): While executing TabSeparatedRowOutputFormat. (NETWORK_ERROR) (version 24.3.12.76.altinitystable) (from [::1]:40090) (in query: EXISTS TABLE test.hits ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Processors/Formats/IOutputFormat.cpp:111: DB::IOutputFormat::flush() @ 0x000000001d547b9c 13. /build/src/Processors/Formats/IOutputFormat.cpp:0: DB::IOutputFormat::work() @ 0x000000001d5478f4 14. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 15. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 16. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 17. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 18. /build/src/Processors/Executors/PipelineExecutor.cpp:411: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514ed5 19. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 20. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 21. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 22. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 23. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 24. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 25. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 26. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 27. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 28. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 29. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 30. ? @ 0x00007f713a222ac3 31. ? @ 0x00007f713a2b4850 2024.12.16 11:34:47.307377 [ 8557 ] {d4fdcca1-7808-4290-9284-11eeb7e88336} DynamicQueryHandler: Cannot flush data to client (after sending exception): Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:51974). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:184: DB::WriteBufferFromHTTPServerResponse::finalizeImpl() @ 0x000000001d49e9d2 11. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 12. /build/src/Server/HTTPHandler.h:94: DB::HTTPHandler::Output::finalize() @ 0x000000001d3ea829 13. /build/src/Server/HTTPHandler.cpp:970: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db33a 14. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.307435 [ 8517 ] {4ecf9739-2de0-4ee7-ae33-50340c0ca78a} executeQuery: Code: 999. Coordination::Exception: Coordination error: Connection loss, path /test/db/test_14. (KEEPER_EXCEPTION) (version 24.3.12.76.altinitystable) (from [::1]:49750) (comment: 01076_range_reader_segfault.sql) (in query: CREATE DATABASE IF NOT EXISTS test_ewqhd64b ENGINE=Replicated('/test/db/test_14', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, String const&) @ 0x0000000018fcc42c 6. /build/src/Common/ZooKeeper/IKeeper.h:488: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, String const&) @ 0x0000000018fcc27d 7. /build/src/Common/ZooKeeper/IKeeper.h:501: Coordination::Exception::fromPath(Coordination::Error, String const&) @ 0x0000000018fc990c 8. /build/src/Common/ZooKeeper/ZooKeeper.cpp:517: zkutil::ZooKeeper::existsWatch(String const&, Coordination::Stat*, std::function) @ 0x000000001e1b3633 9. /build/src/Common/ZooKeeper/ZooKeeper.cpp:498: zkutil::ZooKeeper::exists(String const&, Coordination::Stat*, std::shared_ptr const&) @ 0x000000001e1b13f6 10. /build/src/Databases/DatabaseReplicated.cpp:352: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000001a0ec616 11. /build/src/Databases/DatabaseReplicated.cpp:543: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000001a0f0271 12. /build/src/Databases/TablesLoader.cpp:57: DB::TablesLoader::loadTablesAsync(std::unordered_set, std::hash>, std::equal_to>, std::allocator>>) @ 0x000000001b02ffba 13. /build/src/Interpreters/InterpreterCreateQuery.cpp:338: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000001b00b2ef 14. /build/src/Interpreters/InterpreterCreateQuery.cpp:1791: DB::InterpreterCreateQuery::execute() @ 0x000000001b02103f 15. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 16. /build/src/Interpreters/executeQuery.cpp:1496: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb4e89 17. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 18. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 19. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 20. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 21. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 22. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 23. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 24. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 25. ? @ 0x00007f713a222ac3 26. ? @ 0x00007f713a2b4850 2024.12.16 11:34:47.307600 [ 3868 ] {aac2f946-ffcf-4171-9454-0be2adccf38a} DynamicQueryHandler: Cannot flush data to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:38202). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:184: DB::WriteBufferFromHTTPServerResponse::finalizeImpl() @ 0x000000001d49e9d2 11. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 12. /build/src/Server/HTTPHandler.h:94: DB::HTTPHandler::Output::finalize() @ 0x000000001d3ea829 13. /build/src/Server/HTTPHandler.cpp:910: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da5ca 14. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.307666 [ 8514 ] {02d86d1e-18e1-4f76-a02b-f79f247271da} executeQuery: Code: 253. DB::Exception: Replica r1 of shard s1 of replicated database at /test/db/test_14 already exists. Replica host ID: 'ed2a21f3ed57:9000:9c868dce-a0aa-41d2-9491-b3682ddb4e9a', current host ID: 'ed2a21f3ed57:9000:567badbe-495d-4871-a343-e0bf1f45900b'. (REPLICA_ALREADY_EXISTS) (version 24.3.12.76.altinitystable) (from [::1]:34806) (comment: 02233_set_enable_with_statement_cte_perf.sql) (in query: CREATE DATABASE IF NOT EXISTS test_87dkfmwh ENGINE=Replicated('/test/db/test_14', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, String&, String&, String&, String&, String&) @ 0x000000001a1115da 6. /build/src/Databases/DatabaseReplicated.cpp:375: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000001a0ed3e9 7. /build/src/Databases/DatabaseReplicated.cpp:543: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000001a0f0271 8. /build/src/Databases/TablesLoader.cpp:57: DB::TablesLoader::loadTablesAsync(std::unordered_set, std::hash>, std::equal_to>, std::allocator>>) @ 0x000000001b02ffba 9. /build/src/Interpreters/InterpreterCreateQuery.cpp:338: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000001b00b2ef 10. /build/src/Interpreters/InterpreterCreateQuery.cpp:1791: DB::InterpreterCreateQuery::execute() @ 0x000000001b02103f 11. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 12. /build/src/Interpreters/executeQuery.cpp:1496: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb4e89 13. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 14. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 2024.12.16 11:34:47.307745 [ 3243 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3522: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000001c525e62 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:335: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_1::operator()() const @ 0x000000001c5bde58 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5bde35 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5bde15 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5bddf5 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5bddbd 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.307782 [ 8525 ] {d7f4c04a-ce5a-4323-a695-c30cf66f9b5b} executeQuery: Code: 253. DB::Exception: Replica r1 of shard s1 of replicated database at /test/db/test_14 already exists. Replica host ID: 'ed2a21f3ed57:9000:9c868dce-a0aa-41d2-9491-b3682ddb4e9a', current host ID: 'ed2a21f3ed57:9000:89634421-7964-4ce8-8ae8-5f958852ebb0'. (REPLICA_ALREADY_EXISTS) (version 24.3.12.76.altinitystable) (from [::1]:56854) (comment: 01136_multiple_sets.sql) (in query: CREATE DATABASE IF NOT EXISTS test_9ni4o4sn ENGINE=Replicated('/test/db/test_14', 's1', 'r1') ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, String&, String&, String&, String&, String&) @ 0x000000001a1115da 6. /build/src/Databases/DatabaseReplicated.cpp:375: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000001a0ed3e9 7. /build/src/Databases/DatabaseReplicated.cpp:543: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000001a0f0271 8. /build/src/Databases/TablesLoader.cpp:57: DB::TablesLoader::loadTablesAsync(std::unordered_set, std::hash>, std::equal_to>, std::allocator>>) @ 0x000000001b02ffba 9. /build/src/Interpreters/InterpreterCreateQuery.cpp:338: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000001b00b2ef 10. /build/src/Interpreters/InterpreterCreateQuery.cpp:1791: DB::InterpreterCreateQuery::execute() @ 0x000000001b02103f 11. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 12. /build/src/Interpreters/executeQuery.cpp:1496: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb4e89 13. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 14. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 2024.12.16 11:34:47.308609 [ 8517 ] {4ecf9739-2de0-4ee7-ae33-50340c0ca78a} DynamicQueryHandler: Code: 999. Coordination::Exception: Coordination error: Connection loss, path /test/db/test_14. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, String const&) @ 0x0000000018fcc42c 6. /build/src/Common/ZooKeeper/IKeeper.h:488: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, String const&) @ 0x0000000018fcc27d 7. /build/src/Common/ZooKeeper/IKeeper.h:501: Coordination::Exception::fromPath(Coordination::Error, String const&) @ 0x0000000018fc990c 8. /build/src/Common/ZooKeeper/ZooKeeper.cpp:517: zkutil::ZooKeeper::existsWatch(String const&, Coordination::Stat*, std::function) @ 0x000000001e1b3633 9. /build/src/Common/ZooKeeper/ZooKeeper.cpp:498: zkutil::ZooKeeper::exists(String const&, Coordination::Stat*, std::shared_ptr const&) @ 0x000000001e1b13f6 10. /build/src/Databases/DatabaseReplicated.cpp:352: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000001a0ec616 11. /build/src/Databases/DatabaseReplicated.cpp:543: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000001a0f0271 12. /build/src/Databases/TablesLoader.cpp:57: DB::TablesLoader::loadTablesAsync(std::unordered_set, std::hash>, std::equal_to>, std::allocator>>) @ 0x000000001b02ffba 13. /build/src/Interpreters/InterpreterCreateQuery.cpp:338: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000001b00b2ef 14. /build/src/Interpreters/InterpreterCreateQuery.cpp:1791: DB::InterpreterCreateQuery::execute() @ 0x000000001b02103f 15. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 16. /build/src/Interpreters/executeQuery.cpp:1496: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb4e89 17. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 18. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 19. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 20. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 21. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 22. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 23. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 24. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 25. ? @ 0x00007f713a222ac3 26. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.308783 [ 8514 ] {02d86d1e-18e1-4f76-a02b-f79f247271da} DynamicQueryHandler: Code: 253. DB::Exception: Replica r1 of shard s1 of replicated database at /test/db/test_14 already exists. Replica host ID: 'ed2a21f3ed57:9000:9c868dce-a0aa-41d2-9491-b3682ddb4e9a', current host ID: 'ed2a21f3ed57:9000:567badbe-495d-4871-a343-e0bf1f45900b'. (REPLICA_ALREADY_EXISTS), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, String&, String&, String&, String&, String&) @ 0x000000001a1115da 6. /build/src/Databases/DatabaseReplicated.cpp:375: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000001a0ed3e9 7. /build/src/Databases/DatabaseReplicated.cpp:543: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000001a0f0271 8. /build/src/Databases/TablesLoader.cpp:57: DB::TablesLoader::loadTablesAsync(std::unordered_set, std::hash>, std::equal_to>, std::allocator>>) @ 0x000000001b02ffba 9. /build/src/Interpreters/InterpreterCreateQuery.cpp:338: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000001b00b2ef 10. /build/src/Interpreters/InterpreterCreateQuery.cpp:1791: DB::InterpreterCreateQuery::execute() @ 0x000000001b02103f 11. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 12. /build/src/Interpreters/executeQuery.cpp:1496: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb4e89 13. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 14. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.308819 [ 8548 ] {f94706f2-d862-4674-bab0-2f45cb82e64b} DynamicQueryHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:40090): While executing TabSeparatedRowOutputFormat. (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Processors/Formats/IOutputFormat.cpp:111: DB::IOutputFormat::flush() @ 0x000000001d547b9c 13. /build/src/Processors/Formats/IOutputFormat.cpp:0: DB::IOutputFormat::work() @ 0x000000001d5478f4 14. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 15. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 16. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 17. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 18. /build/src/Processors/Executors/PipelineExecutor.cpp:411: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514ed5 19. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 20. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 21. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 22. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 23. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 24. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 25. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 26. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 27. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 28. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 29. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 30. ? @ 0x00007f713a222ac3 31. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.308962 [ 8525 ] {d7f4c04a-ce5a-4323-a695-c30cf66f9b5b} DynamicQueryHandler: Code: 253. DB::Exception: Replica r1 of shard s1 of replicated database at /test/db/test_14 already exists. Replica host ID: 'ed2a21f3ed57:9000:9c868dce-a0aa-41d2-9491-b3682ddb4e9a', current host ID: 'ed2a21f3ed57:9000:89634421-7964-4ce8-8ae8-5f958852ebb0'. (REPLICA_ALREADY_EXISTS), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, String&, String&, String&, String&, String&) @ 0x000000001a1115da 6. /build/src/Databases/DatabaseReplicated.cpp:375: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000001a0ed3e9 7. /build/src/Databases/DatabaseReplicated.cpp:543: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000001a0f0271 8. /build/src/Databases/TablesLoader.cpp:57: DB::TablesLoader::loadTablesAsync(std::unordered_set, std::hash>, std::equal_to>, std::allocator>>) @ 0x000000001b02ffba 9. /build/src/Interpreters/InterpreterCreateQuery.cpp:338: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000001b00b2ef 10. /build/src/Interpreters/InterpreterCreateQuery.cpp:1791: DB::InterpreterCreateQuery::execute() @ 0x000000001b02103f 11. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 12. /build/src/Interpreters/executeQuery.cpp:1496: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb4e89 13. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 14. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.309464 [ 8517 ] {4ecf9739-2de0-4ee7-ae33-50340c0ca78a} DynamicQueryHandler: Cannot send exception to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:49750). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Server/HTTPHandler.cpp:955: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db57f 13. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 14. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 20. ? @ 0x00007f713a222ac3 21. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.309616 [ 8514 ] {02d86d1e-18e1-4f76-a02b-f79f247271da} DynamicQueryHandler: Cannot send exception to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:34806). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Server/HTTPHandler.cpp:955: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db57f 13. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 14. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 20. ? @ 0x00007f713a222ac3 21. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.309897 [ 8548 ] {f94706f2-d862-4674-bab0-2f45cb82e64b} DynamicQueryHandler: Cannot send exception to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:40090). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/HTTPServerResponse.h:164: DB::HTTPWriteBuffer::nextImplChunked() @ 0x000000001d49ee29 8. /build/src/Server/HTTP/HTTPServerResponse.h:135: DB::HTTPWriteBuffer::nextImpl() @ 0x000000001d49eaef 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:116: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e3bf 10. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 11. /build/src/Server/HTTPHandler.cpp:955: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db57f 12. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 13. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 14. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 15. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 16. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 17. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 18. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 19. ? @ 0x00007f713a222ac3 20. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.309919 [ 8546 ] {b4abf0d2-fa4b-458d-964e-d070dc62efc2} DynamicQueryHandler: Cannot send exception to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:36962). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/HTTPServerResponse.h:164: DB::HTTPWriteBuffer::nextImplChunked() @ 0x000000001d49ee29 8. /build/src/Server/HTTP/HTTPServerResponse.h:135: DB::HTTPWriteBuffer::nextImpl() @ 0x000000001d49eaef 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:116: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e3bf 10. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 11. /build/src/Server/HTTPHandler.cpp:955: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db57f 12. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 13. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 14. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 15. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 16. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 17. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 18. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 19. ? @ 0x00007f713a222ac3 20. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.310040 [ 8517 ] {4ecf9739-2de0-4ee7-ae33-50340c0ca78a} DynamicQueryHandler: Cannot flush data to client (after sending exception): Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:49750). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:184: DB::WriteBufferFromHTTPServerResponse::finalizeImpl() @ 0x000000001d49e9d2 11. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 12. /build/src/Server/HTTPHandler.h:94: DB::HTTPHandler::Output::finalize() @ 0x000000001d3ea829 13. /build/src/Server/HTTPHandler.cpp:970: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db33a 14. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.310196 [ 8514 ] {02d86d1e-18e1-4f76-a02b-f79f247271da} DynamicQueryHandler: Cannot flush data to client (after sending exception): Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:34806). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:184: DB::WriteBufferFromHTTPServerResponse::finalizeImpl() @ 0x000000001d49e9d2 11. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 12. /build/src/Server/HTTPHandler.h:94: DB::HTTPHandler::Output::finalize() @ 0x000000001d3ea829 13. /build/src/Server/HTTPHandler.cpp:970: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db33a 14. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.310250 [ 8561 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a09d07 4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0de47 5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022894827 6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a416b 7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x00000000228a2b09 8. /build/base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::peerAddress() @ 0x00000000228a6a1e 9. /build/base/poco/Net/include/Poco/Net/Socket.h:596: Poco::Net::Socket::peerAddress() const @ 0x00000000133cec28 10. /build/base/poco/Net/src/HTTPServerSession.cpp:65: Poco::Net::HTTPServerSession::clientAddress() @ 0x00000000228831b0 11. /build/src/Server/HTTP/HTTPServerRequest.cpp:34: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&, StrongTypedef const&) @ 0x000000001d4968f9 12. /build/src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x000000001d49595c 13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 18. ? @ 0x00007f713a222ac3 19. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.310298 [ 8542 ] {905fa144-d6d3-4c2b-800d-5fab79b50083} DynamicQueryHandler: Cannot flush data to client (after sending exception): Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:35666). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:184: DB::WriteBufferFromHTTPServerResponse::finalizeImpl() @ 0x000000001d49e9d2 11. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 12. /build/src/Server/HTTPHandler.h:94: DB::HTTPHandler::Output::finalize() @ 0x000000001d3ea829 13. /build/src/Server/HTTPHandler.cpp:970: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db33a 14. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.303109 [ 8509 ] {1b750de3-7821-407b-882c-618d1495cb17} DynamicQueryHandler: Code: 999. Coordination::Exception: Coordination error: Session expired, path /test/db/test_14. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, String const&) @ 0x0000000018fcc42c 6. /build/src/Common/ZooKeeper/IKeeper.h:488: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, String const&) @ 0x0000000018fcc27d 7. /build/src/Common/ZooKeeper/IKeeper.h:501: Coordination::Exception::fromPath(Coordination::Error, String const&) @ 0x0000000018fc990c 8. /build/src/Common/ZooKeeper/ZooKeeper.cpp:517: zkutil::ZooKeeper::existsWatch(String const&, Coordination::Stat*, std::function) @ 0x000000001e1b3633 9. /build/src/Common/ZooKeeper/ZooKeeper.cpp:498: zkutil::ZooKeeper::exists(String const&, Coordination::Stat*, std::shared_ptr const&) @ 0x000000001e1b13f6 10. /build/src/Databases/DatabaseReplicated.cpp:352: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000001a0ec616 11. /build/src/Databases/DatabaseReplicated.cpp:543: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000001a0f0271 12. /build/src/Databases/TablesLoader.cpp:57: DB::TablesLoader::loadTablesAsync(std::unordered_set, std::hash>, std::equal_to>, std::allocator>>) @ 0x000000001b02ffba 13. /build/src/Interpreters/InterpreterCreateQuery.cpp:338: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000001b00b2ef 14. /build/src/Interpreters/InterpreterCreateQuery.cpp:1791: DB::InterpreterCreateQuery::execute() @ 0x000000001b02103f 15. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 16. /build/src/Interpreters/executeQuery.cpp:1496: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb4e89 17. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 18. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 19. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 20. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 21. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 22. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 23. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 24. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 25. ? @ 0x00007f713a222ac3 26. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.310756 [ 8546 ] {b4abf0d2-fa4b-458d-964e-d070dc62efc2} DynamicQueryHandler: Cannot flush data to client (after sending exception): Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:36962). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:184: DB::WriteBufferFromHTTPServerResponse::finalizeImpl() @ 0x000000001d49e9d2 11. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 12. /build/src/Server/HTTPHandler.h:94: DB::HTTPHandler::Output::finalize() @ 0x000000001d3ea829 13. /build/src/Server/HTTPHandler.cpp:970: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db33a 14. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.310793 [ 8535 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a09d07 4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0de47 5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022894827 6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a416b 7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x00000000228a2b09 8. /build/base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::peerAddress() @ 0x00000000228a6a1e 9. /build/base/poco/Net/include/Poco/Net/Socket.h:596: Poco::Net::Socket::peerAddress() const @ 0x00000000133cec28 10. /build/base/poco/Net/src/HTTPServerSession.cpp:65: Poco::Net::HTTPServerSession::clientAddress() @ 0x00000000228831b0 11. /build/src/Server/HTTP/HTTPServerRequest.cpp:34: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&, StrongTypedef const&) @ 0x000000001d4968f9 12. /build/src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x000000001d49595c 13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 18. ? @ 0x00007f713a222ac3 19. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.310861 [ 8555 ] {f4966557-bf1e-4037-9c89-be9874a3f682} executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:59662): While executing TabSeparatedRowOutputFormat. (NETWORK_ERROR) (version 24.3.12.76.altinitystable) (from [::1]:59662) (in query: EXISTS TABLE test.hits ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Processors/Formats/IOutputFormat.cpp:111: DB::IOutputFormat::flush() @ 0x000000001d547b9c 13. /build/src/Processors/Formats/IOutputFormat.cpp:0: DB::IOutputFormat::work() @ 0x000000001d5478f4 14. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 15. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 16. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 17. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 18. /build/src/Processors/Executors/PipelineExecutor.cpp:411: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514ed5 19. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 20. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 21. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 22. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 23. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 24. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 25. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 26. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 27. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 28. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 29. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 30. ? @ 0x00007f713a222ac3 31. ? @ 0x00007f713a2b4850 2024.12.16 11:34:47.311002 [ 8515 ] {a85a81ea-23ed-4e00-bd58-b4fcbd9ccded} DynamicQueryHandler: Code: 253. DB::Exception: Replica r1 of shard s1 of replicated database at /test/db/test_14 already exists. Replica host ID: 'ed2a21f3ed57:9000:9c868dce-a0aa-41d2-9491-b3682ddb4e9a', current host ID: 'ed2a21f3ed57:9000:b4518c8f-f371-4914-9f03-43566fe94a68'. (REPLICA_ALREADY_EXISTS), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, String&, String&, String&, String&, String&) @ 0x000000001a1115da 6. /build/src/Databases/DatabaseReplicated.cpp:375: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000001a0ed3e9 7. /build/src/Databases/DatabaseReplicated.cpp:543: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000001a0f0271 8. /build/src/Databases/TablesLoader.cpp:57: DB::TablesLoader::loadTablesAsync(std::unordered_set, std::hash>, std::equal_to>, std::allocator>>) @ 0x000000001b02ffba 9. /build/src/Interpreters/InterpreterCreateQuery.cpp:338: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000001b00b2ef 10. /build/src/Interpreters/InterpreterCreateQuery.cpp:1791: DB::InterpreterCreateQuery::execute() @ 0x000000001b02103f 11. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 12. /build/src/Interpreters/executeQuery.cpp:1496: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb4e89 13. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 14. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.311046 [ 8544 ] {4a8e9f14-c4f0-4a9f-b727-1bef9208abe9} DynamicQueryHandler: Cannot flush data to client (after sending exception): Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:54992). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:184: DB::WriteBufferFromHTTPServerResponse::finalizeImpl() @ 0x000000001d49e9d2 11. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 12. /build/src/Server/HTTPHandler.h:94: DB::HTTPHandler::Output::finalize() @ 0x000000001d3ea829 13. /build/src/Server/HTTPHandler.cpp:970: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db33a 14. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.310996 [ 8504 ] {433fadc3-62e8-4075-9cda-6d12a0dd5c81} DynamicQueryHandler: Cannot send exception to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:46232). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/HTTPServerResponse.h:164: DB::HTTPWriteBuffer::nextImplChunked() @ 0x000000001d49ee29 8. /build/src/Server/HTTP/HTTPServerResponse.h:135: DB::HTTPWriteBuffer::nextImpl() @ 0x000000001d49eaef 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:116: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e3bf 10. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 11. /build/src/Server/HTTPHandler.cpp:955: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db57f 12. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 13. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 14. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 15. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 16. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 17. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 18. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 19. ? @ 0x00007f713a222ac3 20. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.311320 [ 8514 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a09d07 4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0de47 5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022894827 6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a416b 7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x00000000228a2b09 8. /build/base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::peerAddress() @ 0x00000000228a6a1e 9. /build/base/poco/Net/include/Poco/Net/Socket.h:596: Poco::Net::Socket::peerAddress() const @ 0x00000000133cec28 10. /build/base/poco/Net/src/HTTPServerSession.cpp:65: Poco::Net::HTTPServerSession::clientAddress() @ 0x00000000228831b0 11. /build/src/Server/HTTP/HTTPServerRequest.cpp:34: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&, StrongTypedef const&) @ 0x000000001d4968f9 12. /build/src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x000000001d49595c 13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 18. ? @ 0x00007f713a222ac3 19. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.311628 [ 8562 ] {0c9068af-2e4e-46e2-aade-0b98dde04570} executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:44876): While executing TabSeparatedRowOutputFormat. (NETWORK_ERROR) (version 24.3.12.76.altinitystable) (from [::1]:44876) (in query: EXISTS TABLE test.hits ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Processors/Formats/IOutputFormat.cpp:111: DB::IOutputFormat::flush() @ 0x000000001d547b9c 13. /build/src/Processors/Formats/IOutputFormat.cpp:0: DB::IOutputFormat::work() @ 0x000000001d5478f4 14. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 15. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 16. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 17. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 18. /build/src/Processors/Executors/PipelineExecutor.cpp:411: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514ed5 19. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 20. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 21. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 22. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 23. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 24. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 25. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 26. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 27. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 28. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 29. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 30. ? @ 0x00007f713a222ac3 31. ? @ 0x00007f713a2b4850 2024.12.16 11:34:47.311755 [ 8542 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a09d07 4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0de47 5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022894827 6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a416b 7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x00000000228a2b09 8. /build/base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::peerAddress() @ 0x00000000228a6a1e 9. /build/base/poco/Net/include/Poco/Net/Socket.h:596: Poco::Net::Socket::peerAddress() const @ 0x00000000133cec28 10. /build/base/poco/Net/src/HTTPServerSession.cpp:65: Poco::Net::HTTPServerSession::clientAddress() @ 0x00000000228831b0 11. /build/src/Server/HTTP/HTTPServerRequest.cpp:34: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&, StrongTypedef const&) @ 0x000000001d4968f9 12. /build/src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x000000001d49595c 13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 18. ? @ 0x00007f713a222ac3 19. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.311849 [ 8504 ] {433fadc3-62e8-4075-9cda-6d12a0dd5c81} DynamicQueryHandler: Cannot flush data to client (after sending exception): Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:46232). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:184: DB::WriteBufferFromHTTPServerResponse::finalizeImpl() @ 0x000000001d49e9d2 11. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 12. /build/src/Server/HTTPHandler.h:94: DB::HTTPHandler::Output::finalize() @ 0x000000001d3ea829 13. /build/src/Server/HTTPHandler.cpp:970: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db33a 14. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.311893 [ 8515 ] {a85a81ea-23ed-4e00-bd58-b4fcbd9ccded} DynamicQueryHandler: Cannot send exception to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:54542). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Server/HTTPHandler.cpp:955: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db57f 13. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 14. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 20. ? @ 0x00007f713a222ac3 21. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.311915 [ 8509 ] {1b750de3-7821-407b-882c-618d1495cb17} DynamicQueryHandler: Cannot send exception to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:55410). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Server/HTTPHandler.cpp:955: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db57f 13. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 14. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 20. ? @ 0x00007f713a222ac3 21. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.312081 [ 8555 ] {f4966557-bf1e-4037-9c89-be9874a3f682} DynamicQueryHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:59662): While executing TabSeparatedRowOutputFormat. (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Processors/Formats/IOutputFormat.cpp:111: DB::IOutputFormat::flush() @ 0x000000001d547b9c 13. /build/src/Processors/Formats/IOutputFormat.cpp:0: DB::IOutputFormat::work() @ 0x000000001d5478f4 14. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 15. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 16. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 17. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 18. /build/src/Processors/Executors/PipelineExecutor.cpp:411: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514ed5 19. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 20. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 21. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 22. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 23. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 24. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 25. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 26. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 27. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 28. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 29. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 30. ? @ 0x00007f713a222ac3 31. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.312188 [ 8544 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a09d07 4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0de47 5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022894827 6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a416b 7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x00000000228a2b09 8. /build/base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::peerAddress() @ 0x00000000228a6a1e 9. /build/base/poco/Net/include/Poco/Net/Socket.h:596: Poco::Net::Socket::peerAddress() const @ 0x00000000133cec28 10. /build/base/poco/Net/src/HTTPServerSession.cpp:65: Poco::Net::HTTPServerSession::clientAddress() @ 0x00000000228831b0 11. /build/src/Server/HTTP/HTTPServerRequest.cpp:34: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&, StrongTypedef const&) @ 0x000000001d4968f9 12. /build/src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x000000001d49595c 13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 18. ? @ 0x00007f713a222ac3 19. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.312202 [ 8549 ] {fdb4d478-0c83-473b-8fdd-4cae30c72743} DynamicQueryHandler: Cannot send exception to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:40102). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/HTTPServerResponse.h:164: DB::HTTPWriteBuffer::nextImplChunked() @ 0x000000001d49ee29 8. /build/src/Server/HTTP/HTTPServerResponse.h:135: DB::HTTPWriteBuffer::nextImpl() @ 0x000000001d49eaef 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:116: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e3bf 10. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 11. /build/src/Server/HTTPHandler.cpp:955: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db57f 12. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 13. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 14. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 15. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 16. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 17. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 18. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 19. ? @ 0x00007f713a222ac3 20. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.309833 [ 8553 ] {28b89453-3e04-41a2-b5a6-6747e7e7f626} executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:36898): While executing TabSeparatedRowOutputFormat. (NETWORK_ERROR) (version 24.3.12.76.altinitystable) (from [::1]:36898) (in query: EXISTS TABLE test.hits ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Processors/Formats/IOutputFormat.cpp:111: DB::IOutputFormat::flush() @ 0x000000001d547b9c 13. /build/src/Processors/Formats/IOutputFormat.cpp:0: DB::IOutputFormat::work() @ 0x000000001d5478f4 14. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 15. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 16. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 17. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 18. /build/src/Processors/Executors/PipelineExecutor.cpp:411: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514ed5 19. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 20. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 21. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 22. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 23. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 24. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 25. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 26. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 27. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 28. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 29. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 30. ? @ 0x00007f713a222ac3 31. ? @ 0x00007f713a2b4850 2024.12.16 11:34:47.312481 [ 8515 ] {a85a81ea-23ed-4e00-bd58-b4fcbd9ccded} DynamicQueryHandler: Cannot flush data to client (after sending exception): Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:54542). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:184: DB::WriteBufferFromHTTPServerResponse::finalizeImpl() @ 0x000000001d49e9d2 11. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 12. /build/src/Server/HTTPHandler.h:94: DB::HTTPHandler::Output::finalize() @ 0x000000001d3ea829 13. /build/src/Server/HTTPHandler.cpp:970: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db33a 14. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.312748 [ 8562 ] {0c9068af-2e4e-46e2-aade-0b98dde04570} DynamicQueryHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:44876): While executing TabSeparatedRowOutputFormat. (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Processors/Formats/IOutputFormat.cpp:111: DB::IOutputFormat::flush() @ 0x000000001d547b9c 13. /build/src/Processors/Formats/IOutputFormat.cpp:0: DB::IOutputFormat::work() @ 0x000000001d5478f4 14. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 15. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 16. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 17. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 18. /build/src/Processors/Executors/PipelineExecutor.cpp:411: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514ed5 19. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 20. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 21. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 22. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 23. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 24. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 25. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 26. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 27. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 28. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 29. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 30. ? @ 0x00007f713a222ac3 31. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.312857 [ 8509 ] {1b750de3-7821-407b-882c-618d1495cb17} DynamicQueryHandler: Cannot flush data to client (after sending exception): Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:55410). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:184: DB::WriteBufferFromHTTPServerResponse::finalizeImpl() @ 0x000000001d49e9d2 11. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 12. /build/src/Server/HTTPHandler.h:94: DB::HTTPHandler::Output::finalize() @ 0x000000001d3ea829 13. /build/src/Server/HTTPHandler.cpp:970: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db33a 14. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.312967 [ 8504 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a09d07 4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0de47 5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022894827 6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a416b 7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x00000000228a2b09 8. /build/base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::peerAddress() @ 0x00000000228a6a1e 9. /build/base/poco/Net/include/Poco/Net/Socket.h:596: Poco::Net::Socket::peerAddress() const @ 0x00000000133cec28 10. /build/base/poco/Net/src/HTTPServerSession.cpp:65: Poco::Net::HTTPServerSession::clientAddress() @ 0x00000000228831b0 11. /build/src/Server/HTTP/HTTPServerRequest.cpp:34: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&, StrongTypedef const&) @ 0x000000001d4968f9 12. /build/src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x000000001d49595c 13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 18. ? @ 0x00007f713a222ac3 19. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.313007 [ 8533 ] {0932cc5a-6626-41d0-b078-4dc1ec80c863} DynamicQueryHandler: Cannot flush data to client (after sending exception): Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:48132). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:184: DB::WriteBufferFromHTTPServerResponse::finalizeImpl() @ 0x000000001d49e9d2 11. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 12. /build/src/Server/HTTPHandler.h:94: DB::HTTPHandler::Output::finalize() @ 0x000000001d3ea829 13. /build/src/Server/HTTPHandler.cpp:970: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db33a 14. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.313358 [ 8510 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a09d07 4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0de47 5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022894827 6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a416b 7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x00000000228a2b09 8. /build/base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::peerAddress() @ 0x00000000228a6a1e 9. /build/base/poco/Net/include/Poco/Net/Socket.h:596: Poco::Net::Socket::peerAddress() const @ 0x00000000133cec28 10. /build/base/poco/Net/src/HTTPServerSession.cpp:65: Poco::Net::HTTPServerSession::clientAddress() @ 0x00000000228831b0 11. /build/src/Server/HTTP/HTTPServerRequest.cpp:34: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&, StrongTypedef const&) @ 0x000000001d4968f9 12. /build/src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x000000001d49595c 13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 18. ? @ 0x00007f713a222ac3 19. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.313395 [ 8553 ] {28b89453-3e04-41a2-b5a6-6747e7e7f626} DynamicQueryHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:36898): While executing TabSeparatedRowOutputFormat. (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Processors/Formats/IOutputFormat.cpp:111: DB::IOutputFormat::flush() @ 0x000000001d547b9c 13. /build/src/Processors/Formats/IOutputFormat.cpp:0: DB::IOutputFormat::work() @ 0x000000001d5478f4 14. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 15. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 16. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 17. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 18. /build/src/Processors/Executors/PipelineExecutor.cpp:411: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514ed5 19. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 20. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 21. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 22. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 23. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 24. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 25. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 26. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 27. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 28. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 29. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 30. ? @ 0x00007f713a222ac3 31. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.313419 [ 8562 ] {0c9068af-2e4e-46e2-aade-0b98dde04570} DynamicQueryHandler: Cannot send exception to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:44876). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/HTTPServerResponse.h:164: DB::HTTPWriteBuffer::nextImplChunked() @ 0x000000001d49ee29 8. /build/src/Server/HTTP/HTTPServerResponse.h:135: DB::HTTPWriteBuffer::nextImpl() @ 0x000000001d49eaef 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:116: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e3bf 10. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 11. /build/src/Server/HTTPHandler.cpp:955: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db57f 12. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 13. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 14. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 15. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 16. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 17. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 18. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 19. ? @ 0x00007f713a222ac3 20. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.313647 [ 8521 ] {ad56f663-4427-4396-a3f4-f234da72f38f} DynamicQueryHandler: Cannot send exception to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:47720). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Server/HTTPHandler.cpp:955: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db57f 13. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 14. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 20. ? @ 0x00007f713a222ac3 21. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.313666 [ 8552 ] {7fe49ba4-63f9-4ed8-ae8a-302c749eb427} DynamicQueryHandler: Cannot send exception to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:36882). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/HTTPServerResponse.h:164: DB::HTTPWriteBuffer::nextImplChunked() @ 0x000000001d49ee29 8. /build/src/Server/HTTP/HTTPServerResponse.h:135: DB::HTTPWriteBuffer::nextImpl() @ 0x000000001d49eaef 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:116: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e3bf 10. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 11. /build/src/Server/HTTPHandler.cpp:955: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db57f 12. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 13. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 14. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 15. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 16. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 17. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 18. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 19. ? @ 0x00007f713a222ac3 20. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.313700 [ 8540 ] {ca3ad549-3c62-4f02-8bf5-7e87173e3681} DynamicQueryHandler: Cannot send exception to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:35780). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/HTTPServerResponse.h:164: DB::HTTPWriteBuffer::nextImplChunked() @ 0x000000001d49ee29 8. /build/src/Server/HTTP/HTTPServerResponse.h:135: DB::HTTPWriteBuffer::nextImpl() @ 0x000000001d49eaef 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:116: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e3bf 10. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 11. /build/src/Server/HTTPHandler.cpp:955: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db57f 12. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 13. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 14. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 15. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 16. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 17. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 18. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 19. ? @ 0x00007f713a222ac3 20. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.313789 [ 3731 ] {1f60a0ed-dd49-4ed1-8f08-14ee1d70d0b6} DynamicQueryHandler: Cannot flush data to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:37266). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:184: DB::WriteBufferFromHTTPServerResponse::finalizeImpl() @ 0x000000001d49e9d2 11. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 12. /build/src/Server/HTTPHandler.h:94: DB::HTTPHandler::Output::finalize() @ 0x000000001d3ea829 13. /build/src/Server/HTTPHandler.cpp:910: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da5ca 14. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.314130 [ 8562 ] {0c9068af-2e4e-46e2-aade-0b98dde04570} DynamicQueryHandler: Cannot flush data to client (after sending exception): Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:44876). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:184: DB::WriteBufferFromHTTPServerResponse::finalizeImpl() @ 0x000000001d49e9d2 11. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 12. /build/src/Server/HTTPHandler.h:94: DB::HTTPHandler::Output::finalize() @ 0x000000001d3ea829 13. /build/src/Server/HTTPHandler.cpp:970: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db33a 14. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.314246 [ 8521 ] {ad56f663-4427-4396-a3f4-f234da72f38f} DynamicQueryHandler: Cannot flush data to client (after sending exception): Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:47720). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:184: DB::WriteBufferFromHTTPServerResponse::finalizeImpl() @ 0x000000001d49e9d2 11. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 12. /build/src/Server/HTTPHandler.h:94: DB::HTTPHandler::Output::finalize() @ 0x000000001d3ea829 13. /build/src/Server/HTTPHandler.cpp:970: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db33a 14. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.314293 [ 8552 ] {7fe49ba4-63f9-4ed8-ae8a-302c749eb427} DynamicQueryHandler: Cannot flush data to client (after sending exception): Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:36882). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:184: DB::WriteBufferFromHTTPServerResponse::finalizeImpl() @ 0x000000001d49e9d2 11. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 12. /build/src/Server/HTTPHandler.h:94: DB::HTTPHandler::Output::finalize() @ 0x000000001d3ea829 13. /build/src/Server/HTTPHandler.cpp:970: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db33a 14. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.314322 [ 8540 ] {ca3ad549-3c62-4f02-8bf5-7e87173e3681} DynamicQueryHandler: Cannot flush data to client (after sending exception): Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:35780). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:184: DB::WriteBufferFromHTTPServerResponse::finalizeImpl() @ 0x000000001d49e9d2 11. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 12. /build/src/Server/HTTPHandler.h:94: DB::HTTPHandler::Output::finalize() @ 0x000000001d3ea829 13. /build/src/Server/HTTPHandler.cpp:970: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db33a 14. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.314322 [ 8553 ] {28b89453-3e04-41a2-b5a6-6747e7e7f626} DynamicQueryHandler: Cannot send exception to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:36898). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/HTTPServerResponse.h:164: DB::HTTPWriteBuffer::nextImplChunked() @ 0x000000001d49ee29 8. /build/src/Server/HTTP/HTTPServerResponse.h:135: DB::HTTPWriteBuffer::nextImpl() @ 0x000000001d49eaef 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:116: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e3bf 10. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 11. /build/src/Server/HTTPHandler.cpp:955: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db57f 12. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 13. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 14. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 15. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 16. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 17. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 18. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 19. ? @ 0x00007f713a222ac3 20. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.314366 [ 8509 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a09d07 4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0de47 5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022894827 6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a416b 7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x00000000228a2b09 8. /build/base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::peerAddress() @ 0x00000000228a6a1e 9. /build/base/poco/Net/include/Poco/Net/Socket.h:596: Poco::Net::Socket::peerAddress() const @ 0x00000000133cec28 10. /build/base/poco/Net/src/HTTPServerSession.cpp:65: Poco::Net::HTTPServerSession::clientAddress() @ 0x00000000228831b0 11. /build/src/Server/HTTP/HTTPServerRequest.cpp:34: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&, StrongTypedef const&) @ 0x000000001d4968f9 12. /build/src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x000000001d49595c 13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 18. ? @ 0x00007f713a222ac3 19. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.315221 [ 3731 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a09d07 4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0de47 5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022894827 6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a416b 7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x00000000228a2b09 8. /build/base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::peerAddress() @ 0x00000000228a6a1e 9. /build/base/poco/Net/include/Poco/Net/Socket.h:596: Poco::Net::Socket::peerAddress() const @ 0x00000000133cec28 10. /build/base/poco/Net/src/HTTPServerSession.cpp:65: Poco::Net::HTTPServerSession::clientAddress() @ 0x00000000228831b0 11. /build/src/Server/HTTP/HTTPServerRequest.cpp:34: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&, StrongTypedef const&) @ 0x000000001d4968f9 12. /build/src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x000000001d49595c 13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 18. ? @ 0x00007f713a222ac3 19. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.315411 [ 8539 ] {31a73105-8f76-4a1f-acd2-6d1d4ef0c242} DynamicQueryHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:60472): While executing TabSeparatedRowOutputFormat. (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Processors/Formats/IOutputFormat.cpp:111: DB::IOutputFormat::flush() @ 0x000000001d547b9c 13. /build/src/Processors/Formats/IOutputFormat.cpp:0: DB::IOutputFormat::work() @ 0x000000001d5478f4 14. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 15. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 16. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 17. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 18. /build/src/Processors/Executors/PipelineExecutor.cpp:411: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514ed5 19. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 20. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 21. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 22. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 23. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 24. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 25. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 26. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 27. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 28. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 29. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 30. ? @ 0x00007f713a222ac3 31. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.315482 [ 8563 ] {e2fa5b8f-5120-4e93-aa0b-53487d496aea} DynamicQueryHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:42834): While executing TabSeparatedRowOutputFormat. (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Processors/Formats/IOutputFormat.cpp:111: DB::IOutputFormat::flush() @ 0x000000001d547b9c 13. /build/src/Processors/Formats/IOutputFormat.cpp:0: DB::IOutputFormat::work() @ 0x000000001d5478f4 14. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 15. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 16. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 17. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 18. /build/src/Processors/Executors/PipelineExecutor.cpp:411: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514ed5 19. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 20. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 21. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 22. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 23. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 24. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 25. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 26. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 27. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 28. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 29. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 30. ? @ 0x00007f713a222ac3 31. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.315578 [ 8549 ] {fdb4d478-0c83-473b-8fdd-4cae30c72743} DynamicQueryHandler: Cannot flush data to client (after sending exception): Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:40102). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:184: DB::WriteBufferFromHTTPServerResponse::finalizeImpl() @ 0x000000001d49e9d2 11. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 12. /build/src/Server/HTTPHandler.h:94: DB::HTTPHandler::Output::finalize() @ 0x000000001d3ea829 13. /build/src/Server/HTTPHandler.cpp:970: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db33a 14. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.315627 [ 8513 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a09d07 4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0de47 5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022894827 6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a416b 7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x00000000228a2b09 8. /build/base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::peerAddress() @ 0x00000000228a6a1e 9. /build/base/poco/Net/include/Poco/Net/Socket.h:596: Poco::Net::Socket::peerAddress() const @ 0x00000000133cec28 10. /build/base/poco/Net/src/HTTPServerSession.cpp:65: Poco::Net::HTTPServerSession::clientAddress() @ 0x00000000228831b0 11. /build/src/Server/HTTP/HTTPServerRequest.cpp:34: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&, StrongTypedef const&) @ 0x000000001d4968f9 12. /build/src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x000000001d49595c 13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 18. ? @ 0x00007f713a222ac3 19. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.315986 [ 8534 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a09d07 4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0de47 5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022894827 6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a416b 7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x00000000228a2b09 8. /build/base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::peerAddress() @ 0x00000000228a6a1e 9. /build/base/poco/Net/include/Poco/Net/Socket.h:596: Poco::Net::Socket::peerAddress() const @ 0x00000000133cec28 10. /build/base/poco/Net/src/HTTPServerSession.cpp:65: Poco::Net::HTTPServerSession::clientAddress() @ 0x00000000228831b0 11. /build/src/Server/HTTP/HTTPServerRequest.cpp:34: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&, StrongTypedef const&) @ 0x000000001d4968f9 12. /build/src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x000000001d49595c 13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 18. ? @ 0x00007f713a222ac3 19. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.316055 [ 8553 ] {28b89453-3e04-41a2-b5a6-6747e7e7f626} DynamicQueryHandler: Cannot flush data to client (after sending exception): Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:36898). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:184: DB::WriteBufferFromHTTPServerResponse::finalizeImpl() @ 0x000000001d49e9d2 11. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 12. /build/src/Server/HTTPHandler.h:94: DB::HTTPHandler::Output::finalize() @ 0x000000001d3ea829 13. /build/src/Server/HTTPHandler.cpp:970: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db33a 14. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.316448 [ 8563 ] {e2fa5b8f-5120-4e93-aa0b-53487d496aea} DynamicQueryHandler: Cannot send exception to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:42834). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/HTTPServerResponse.h:164: DB::HTTPWriteBuffer::nextImplChunked() @ 0x000000001d49ee29 8. /build/src/Server/HTTP/HTTPServerResponse.h:135: DB::HTTPWriteBuffer::nextImpl() @ 0x000000001d49eaef 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:116: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e3bf 10. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 11. /build/src/Server/HTTPHandler.cpp:955: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db57f 12. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 13. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 14. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 15. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 16. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 17. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 18. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 19. ? @ 0x00007f713a222ac3 20. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.317322 [ 8563 ] {e2fa5b8f-5120-4e93-aa0b-53487d496aea} DynamicQueryHandler: Cannot flush data to client (after sending exception): Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:42834). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:184: DB::WriteBufferFromHTTPServerResponse::finalizeImpl() @ 0x000000001d49e9d2 11. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 12. /build/src/Server/HTTPHandler.h:94: DB::HTTPHandler::Output::finalize() @ 0x000000001d3ea829 13. /build/src/Server/HTTPHandler.cpp:970: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db33a 14. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.316077 [ 8539 ] {31a73105-8f76-4a1f-acd2-6d1d4ef0c242} DynamicQueryHandler: Cannot send exception to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:60472). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/HTTPServerResponse.h:164: DB::HTTPWriteBuffer::nextImplChunked() @ 0x000000001d49ee29 8. /build/src/Server/HTTP/HTTPServerResponse.h:135: DB::HTTPWriteBuffer::nextImpl() @ 0x000000001d49eaef 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:116: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e3bf 10. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 11. /build/src/Server/HTTPHandler.cpp:955: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db57f 12. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 13. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 14. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 15. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 16. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 17. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 18. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 19. ? @ 0x00007f713a222ac3 20. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.316765 [ 8533 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a09d07 4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0de47 5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022894827 6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a416b 7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x00000000228a2b09 8. /build/base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::peerAddress() @ 0x00000000228a6a1e 9. /build/base/poco/Net/include/Poco/Net/Socket.h:596: Poco::Net::Socket::peerAddress() const @ 0x00000000133cec28 10. /build/base/poco/Net/src/HTTPServerSession.cpp:65: Poco::Net::HTTPServerSession::clientAddress() @ 0x00000000228831b0 11. /build/src/Server/HTTP/HTTPServerRequest.cpp:34: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&, StrongTypedef const&) @ 0x000000001d4968f9 12. /build/src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x000000001d49595c 13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 18. ? @ 0x00007f713a222ac3 19. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.328536 [ 3751 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a09d07 4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0de47 5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022894827 6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a416b 7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x00000000228a2b09 8. /build/base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::peerAddress() @ 0x00000000228a6a1e 9. /build/base/poco/Net/include/Poco/Net/Socket.h:596: Poco::Net::Socket::peerAddress() const @ 0x00000000133cec28 10. /build/base/poco/Net/src/HTTPServerSession.cpp:65: Poco::Net::HTTPServerSession::clientAddress() @ 0x00000000228831b0 11. /build/src/Server/HTTP/HTTPServerRequest.cpp:34: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&, StrongTypedef const&) @ 0x000000001d4968f9 12. /build/src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x000000001d49595c 13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 18. ? @ 0x00007f713a222ac3 19. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.328870 [ 8539 ] {31a73105-8f76-4a1f-acd2-6d1d4ef0c242} DynamicQueryHandler: Cannot flush data to client (after sending exception): Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:60472). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:184: DB::WriteBufferFromHTTPServerResponse::finalizeImpl() @ 0x000000001d49e9d2 11. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 12. /build/src/Server/HTTPHandler.h:94: DB::HTTPHandler::Output::finalize() @ 0x000000001d3ea829 13. /build/src/Server/HTTPHandler.cpp:970: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db33a 14. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.320159 [ 8520 ] {09c5bcd9-e183-485c-a05c-620b949a5112} DynamicQueryHandler: Code: 253. DB::Exception: Replica r1 of shard s1 of replicated database at /test/db/test_14 already exists. Replica host ID: 'ed2a21f3ed57:9000:9c868dce-a0aa-41d2-9491-b3682ddb4e9a', current host ID: 'ed2a21f3ed57:9000:527b26b1-3b1e-4132-a6e4-53a3c0c681a5'. (REPLICA_ALREADY_EXISTS), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, String&, String&, String&, String&, String&) @ 0x000000001a1115da 6. /build/src/Databases/DatabaseReplicated.cpp:375: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000001a0ed3e9 7. /build/src/Databases/DatabaseReplicated.cpp:543: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000001a0f0271 8. /build/src/Databases/TablesLoader.cpp:57: DB::TablesLoader::loadTablesAsync(std::unordered_set, std::hash>, std::equal_to>, std::allocator>>) @ 0x000000001b02ffba 9. /build/src/Interpreters/InterpreterCreateQuery.cpp:338: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000001b00b2ef 10. /build/src/Interpreters/InterpreterCreateQuery.cpp:1791: DB::InterpreterCreateQuery::execute() @ 0x000000001b02103f 11. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 12. /build/src/Interpreters/executeQuery.cpp:1496: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb4e89 13. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 14. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.330972 [ 8520 ] {09c5bcd9-e183-485c-a05c-620b949a5112} DynamicQueryHandler: Cannot send exception to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:49556). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Server/HTTPHandler.cpp:955: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db57f 13. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 14. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 20. ? @ 0x00007f713a222ac3 21. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.332932 [ 8520 ] {09c5bcd9-e183-485c-a05c-620b949a5112} DynamicQueryHandler: Cannot flush data to client (after sending exception): Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:49556). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:184: DB::WriteBufferFromHTTPServerResponse::finalizeImpl() @ 0x000000001d49e9d2 11. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 12. /build/src/Server/HTTPHandler.h:94: DB::HTTPHandler::Output::finalize() @ 0x000000001d3ea829 13. /build/src/Server/HTTPHandler.cpp:970: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db33a 14. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.320291 [ 8524 ] {424fa945-4d36-4fc9-893c-372e43965ea0} DynamicQueryHandler: Cannot send exception to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:48454). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Server/HTTPHandler.cpp:955: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db57f 13. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 14. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 20. ? @ 0x00007f713a222ac3 21. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.335342 [ 8524 ] {424fa945-4d36-4fc9-893c-372e43965ea0} DynamicQueryHandler: Cannot flush data to client (after sending exception): Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:48454). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:184: DB::WriteBufferFromHTTPServerResponse::finalizeImpl() @ 0x000000001d49e9d2 11. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 12. /build/src/Server/HTTPHandler.h:94: DB::HTTPHandler::Output::finalize() @ 0x000000001d3ea829 13. /build/src/Server/HTTPHandler.cpp:970: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db33a 14. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.320298 [ 8511 ] {f23f989b-f9c1-47bb-9728-d03bc28b30ef} DynamicQueryHandler: Cannot flush data to client (after sending exception): Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:53758). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:184: DB::WriteBufferFromHTTPServerResponse::finalizeImpl() @ 0x000000001d49e9d2 11. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 12. /build/src/Server/HTTPHandler.h:94: DB::HTTPHandler::Output::finalize() @ 0x000000001d3ea829 13. /build/src/Server/HTTPHandler.cpp:970: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db33a 14. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.320310 [ 8543 ] {bc6e40fb-6d11-4b3e-b5ca-f58afe01a76d} DynamicQueryHandler: Cannot flush data to client (after sending exception): Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:54990). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:184: DB::WriteBufferFromHTTPServerResponse::finalizeImpl() @ 0x000000001d49e9d2 11. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 12. /build/src/Server/HTTPHandler.h:94: DB::HTTPHandler::Output::finalize() @ 0x000000001d3ea829 13. /build/src/Server/HTTPHandler.cpp:970: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db33a 14. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.320526 [ 8506 ] {9c38e6cf-8486-46f4-8cd7-973c72337f4f} DynamicQueryHandler: Cannot send exception to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:59162). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/HTTPServerResponse.h:164: DB::HTTPWriteBuffer::nextImplChunked() @ 0x000000001d49ee29 8. /build/src/Server/HTTP/HTTPServerResponse.h:135: DB::HTTPWriteBuffer::nextImpl() @ 0x000000001d49eaef 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:116: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e3bf 10. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 11. /build/src/Server/HTTPHandler.cpp:955: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db57f 12. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 13. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 14. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 15. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 16. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 17. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 18. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 19. ? @ 0x00007f713a222ac3 20. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.320579 [ 8556 ] {2b56d17a-23ed-49db-89ea-5b9b7780d8e1} DynamicQueryHandler: Cannot flush data to client (after sending exception): Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:34658). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:184: DB::WriteBufferFromHTTPServerResponse::finalizeImpl() @ 0x000000001d49e9d2 11. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 12. /build/src/Server/HTTPHandler.h:94: DB::HTTPHandler::Output::finalize() @ 0x000000001d3ea829 13. /build/src/Server/HTTPHandler.cpp:970: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db33a 14. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.320617 [ 8508 ] {e908df23-54cf-4935-857b-2e4d9e700835} DynamicQueryHandler: Cannot flush data to client (after sending exception): Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:59176). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:184: DB::WriteBufferFromHTTPServerResponse::finalizeImpl() @ 0x000000001d49e9d2 11. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 12. /build/src/Server/HTTPHandler.h:94: DB::HTTPHandler::Output::finalize() @ 0x000000001d3ea829 13. /build/src/Server/HTTPHandler.cpp:970: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db33a 14. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.340650 [ 8511 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a09d07 4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0de47 5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022894827 6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a416b 7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x00000000228a2b09 8. /build/base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::peerAddress() @ 0x00000000228a6a1e 9. /build/base/poco/Net/include/Poco/Net/Socket.h:596: Poco::Net::Socket::peerAddress() const @ 0x00000000133cec28 10. /build/base/poco/Net/src/HTTPServerSession.cpp:65: Poco::Net::HTTPServerSession::clientAddress() @ 0x00000000228831b0 11. /build/src/Server/HTTP/HTTPServerRequest.cpp:34: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&, StrongTypedef const&) @ 0x000000001d4968f9 12. /build/src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x000000001d49595c 13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 18. ? @ 0x00007f713a222ac3 19. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.320844 [ 8525 ] {d7f4c04a-ce5a-4323-a695-c30cf66f9b5b} DynamicQueryHandler: Cannot send exception to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:56854). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Server/HTTPHandler.cpp:955: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db57f 13. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 14. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 20. ? @ 0x00007f713a222ac3 21. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.341070 [ 8506 ] {9c38e6cf-8486-46f4-8cd7-973c72337f4f} DynamicQueryHandler: Cannot flush data to client (after sending exception): Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:59162). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:184: DB::WriteBufferFromHTTPServerResponse::finalizeImpl() @ 0x000000001d49e9d2 11. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 12. /build/src/Server/HTTPHandler.h:94: DB::HTTPHandler::Output::finalize() @ 0x000000001d3ea829 13. /build/src/Server/HTTPHandler.cpp:970: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db33a 14. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.320972 [ 8548 ] {f94706f2-d862-4674-bab0-2f45cb82e64b} DynamicQueryHandler: Cannot flush data to client (after sending exception): Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:40090). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:184: DB::WriteBufferFromHTTPServerResponse::finalizeImpl() @ 0x000000001d49e9d2 11. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 12. /build/src/Server/HTTPHandler.h:94: DB::HTTPHandler::Output::finalize() @ 0x000000001d3ea829 13. /build/src/Server/HTTPHandler.cpp:970: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db33a 14. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.321221 [ 8551 ] {613fdbda-b7c8-4e65-b8e8-f4b43ed3df65} executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:34138): While executing TabSeparatedRowOutputFormat. (NETWORK_ERROR) (version 24.3.12.76.altinitystable) (from [::1]:34138) (in query: EXISTS TABLE test.hits ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Processors/Formats/IOutputFormat.cpp:111: DB::IOutputFormat::flush() @ 0x000000001d547b9c 13. /build/src/Processors/Formats/IOutputFormat.cpp:0: DB::IOutputFormat::work() @ 0x000000001d5478f4 14. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 15. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 16. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 17. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 18. /build/src/Processors/Executors/PipelineExecutor.cpp:411: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514ed5 19. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 20. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 21. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 22. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 23. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 24. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 25. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 26. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 27. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 28. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 29. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 30. ? @ 0x00007f713a222ac3 31. ? @ 0x00007f713a2b4850 2024.12.16 11:34:47.321676 [ 8554 ] {f74d532f-84a9-4d57-98cc-036131d97de1} DynamicQueryHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:60210): While executing TabSeparatedRowOutputFormat. (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Processors/Formats/IOutputFormat.cpp:111: DB::IOutputFormat::flush() @ 0x000000001d547b9c 13. /build/src/Processors/Formats/IOutputFormat.cpp:0: DB::IOutputFormat::work() @ 0x000000001d5478f4 14. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 15. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 16. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 17. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 18. /build/src/Processors/Executors/PipelineExecutor.cpp:411: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514ed5 19. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 20. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 21. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 22. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 23. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 24. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 25. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 26. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 27. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 28. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 29. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 30. ? @ 0x00007f713a222ac3 31. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.348526 [ 8554 ] {f74d532f-84a9-4d57-98cc-036131d97de1} DynamicQueryHandler: Cannot send exception to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:60210). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/HTTPServerResponse.h:164: DB::HTTPWriteBuffer::nextImplChunked() @ 0x000000001d49ee29 8. /build/src/Server/HTTP/HTTPServerResponse.h:135: DB::HTTPWriteBuffer::nextImpl() @ 0x000000001d49eaef 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:116: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e3bf 10. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 11. /build/src/Server/HTTPHandler.cpp:955: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db57f 12. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 13. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 14. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 15. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 16. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 17. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 18. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 19. ? @ 0x00007f713a222ac3 20. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.348917 [ 8551 ] {613fdbda-b7c8-4e65-b8e8-f4b43ed3df65} DynamicQueryHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:34138): While executing TabSeparatedRowOutputFormat. (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Processors/Formats/IOutputFormat.cpp:111: DB::IOutputFormat::flush() @ 0x000000001d547b9c 13. /build/src/Processors/Formats/IOutputFormat.cpp:0: DB::IOutputFormat::work() @ 0x000000001d5478f4 14. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 15. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 16. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 17. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 18. /build/src/Processors/Executors/PipelineExecutor.cpp:411: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514ed5 19. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 20. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 21. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 22. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 23. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 24. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 25. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 26. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 27. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 28. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 29. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 30. ? @ 0x00007f713a222ac3 31. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.349144 [ 8554 ] {f74d532f-84a9-4d57-98cc-036131d97de1} DynamicQueryHandler: Cannot flush data to client (after sending exception): Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:60210). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:184: DB::WriteBufferFromHTTPServerResponse::finalizeImpl() @ 0x000000001d49e9d2 11. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 12. /build/src/Server/HTTPHandler.h:94: DB::HTTPHandler::Output::finalize() @ 0x000000001d3ea829 13. /build/src/Server/HTTPHandler.cpp:970: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db33a 14. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.349651 [ 8551 ] {613fdbda-b7c8-4e65-b8e8-f4b43ed3df65} DynamicQueryHandler: Cannot send exception to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:34138). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/HTTPServerResponse.h:164: DB::HTTPWriteBuffer::nextImplChunked() @ 0x000000001d49ee29 8. /build/src/Server/HTTP/HTTPServerResponse.h:135: DB::HTTPWriteBuffer::nextImpl() @ 0x000000001d49eaef 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:116: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e3bf 10. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 11. /build/src/Server/HTTPHandler.cpp:955: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db57f 12. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 13. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 14. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 15. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 16. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 17. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 18. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 19. ? @ 0x00007f713a222ac3 20. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.350249 [ 8551 ] {613fdbda-b7c8-4e65-b8e8-f4b43ed3df65} DynamicQueryHandler: Cannot flush data to client (after sending exception): Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:34138). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:184: DB::WriteBufferFromHTTPServerResponse::finalizeImpl() @ 0x000000001d49e9d2 11. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 12. /build/src/Server/HTTPHandler.h:94: DB::HTTPHandler::Output::finalize() @ 0x000000001d3ea829 13. /build/src/Server/HTTPHandler.cpp:970: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db33a 14. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.321607 [ 8550 ] {78fde84f-e8ea-462b-a071-9bcabf0bc1f9} executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:42350): While executing TabSeparatedRowOutputFormat. (NETWORK_ERROR) (version 24.3.12.76.altinitystable) (from [::1]:42350) (in query: EXISTS TABLE test.hits ), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Processors/Formats/IOutputFormat.cpp:111: DB::IOutputFormat::flush() @ 0x000000001d547b9c 13. /build/src/Processors/Formats/IOutputFormat.cpp:0: DB::IOutputFormat::work() @ 0x000000001d5478f4 14. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 15. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 16. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 17. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 18. /build/src/Processors/Executors/PipelineExecutor.cpp:411: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514ed5 19. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 20. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 21. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 22. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 23. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 24. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 25. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 26. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 27. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 28. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 29. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 30. ? @ 0x00007f713a222ac3 31. ? @ 0x00007f713a2b4850 2024.12.16 11:34:47.321917 [ 8519 ] {aa9f51a3-84de-4c6d-bad1-e7dddcd16c74} DynamicQueryHandler: Code: 253. DB::Exception: Replica r1 of shard s1 of replicated database at /test/db/test_14 already exists. Replica host ID: 'ed2a21f3ed57:9000:9c868dce-a0aa-41d2-9491-b3682ddb4e9a', current host ID: 'ed2a21f3ed57:9000:70b9c93f-8a29-4001-b899-afb9d05f236d'. (REPLICA_ALREADY_EXISTS), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, String&, String&, String&, String&, String&) @ 0x000000001a1115da 6. /build/src/Databases/DatabaseReplicated.cpp:375: DB::DatabaseReplicated::tryConnectToZooKeeperAndInitDatabase(DB::LoadingStrictnessLevel) @ 0x000000001a0ed3e9 7. /build/src/Databases/DatabaseReplicated.cpp:543: DB::DatabaseReplicated::beforeLoadingMetadata(std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000001a0f0271 8. /build/src/Databases/TablesLoader.cpp:57: DB::TablesLoader::loadTablesAsync(std::unordered_set, std::hash>, std::equal_to>, std::allocator>>) @ 0x000000001b02ffba 9. /build/src/Interpreters/InterpreterCreateQuery.cpp:338: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000001b00b2ef 10. /build/src/Interpreters/InterpreterCreateQuery.cpp:1791: DB::InterpreterCreateQuery::execute() @ 0x000000001b02103f 11. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 12. /build/src/Interpreters/executeQuery.cpp:1496: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb4e89 13. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 14. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.312759 [ 8555 ] {f4966557-bf1e-4037-9c89-be9874a3f682} DynamicQueryHandler: Cannot send exception to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:59662). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/HTTPServerResponse.h:164: DB::HTTPWriteBuffer::nextImplChunked() @ 0x000000001d49ee29 8. /build/src/Server/HTTP/HTTPServerResponse.h:135: DB::HTTPWriteBuffer::nextImpl() @ 0x000000001d49eaef 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:116: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e3bf 10. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 11. /build/src/Server/HTTPHandler.cpp:955: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db57f 12. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 13. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 14. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 15. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 16. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 17. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 18. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 19. ? @ 0x00007f713a222ac3 20. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.320206 [ 3855 ] {79789f6b-7434-488d-ade5-3eaf05a9d578} DynamicQueryHandler: Cannot flush data to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:59892). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:184: DB::WriteBufferFromHTTPServerResponse::finalizeImpl() @ 0x000000001d49e9d2 11. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 12. /build/src/Server/HTTPHandler.h:94: DB::HTTPHandler::Output::finalize() @ 0x000000001d3ea829 13. /build/src/Server/HTTPHandler.cpp:910: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da5ca 14. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.351512 [ 8555 ] {f4966557-bf1e-4037-9c89-be9874a3f682} DynamicQueryHandler: Cannot flush data to client (after sending exception): Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:59662). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:184: DB::WriteBufferFromHTTPServerResponse::finalizeImpl() @ 0x000000001d49e9d2 11. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 12. /build/src/Server/HTTPHandler.h:94: DB::HTTPHandler::Output::finalize() @ 0x000000001d3ea829 13. /build/src/Server/HTTPHandler.cpp:970: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db33a 14. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.351737 [ 8519 ] {aa9f51a3-84de-4c6d-bad1-e7dddcd16c74} DynamicQueryHandler: Cannot send exception to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:56288). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Server/HTTPHandler.cpp:955: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db57f 13. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 14. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 20. ? @ 0x00007f713a222ac3 21. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.320878 [ 8512 ] {38736ac8-fda5-490d-8faf-03c19e915abd} DynamicQueryHandler: Cannot flush data to client (after sending exception): Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:40852). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:184: DB::WriteBufferFromHTTPServerResponse::finalizeImpl() @ 0x000000001d49e9d2 11. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 12. /build/src/Server/HTTPHandler.h:94: DB::HTTPHandler::Output::finalize() @ 0x000000001d3ea829 13. /build/src/Server/HTTPHandler.cpp:970: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db33a 14. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.341185 [ 8556 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a09d07 4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0de47 5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022894827 6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a416b 7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x00000000228a2b09 8. /build/base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::peerAddress() @ 0x00000000228a6a1e 9. /build/base/poco/Net/include/Poco/Net/Socket.h:596: Poco::Net::Socket::peerAddress() const @ 0x00000000133cec28 10. /build/base/poco/Net/src/HTTPServerSession.cpp:65: Poco::Net::HTTPServerSession::clientAddress() @ 0x00000000228831b0 11. /build/src/Server/HTTP/HTTPServerRequest.cpp:34: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&, StrongTypedef const&) @ 0x000000001d4968f9 12. /build/src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x000000001d49595c 13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 18. ? @ 0x00007f713a222ac3 19. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.341441 [ 8525 ] {d7f4c04a-ce5a-4323-a695-c30cf66f9b5b} DynamicQueryHandler: Cannot flush data to client (after sending exception): Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:56854). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:184: DB::WriteBufferFromHTTPServerResponse::finalizeImpl() @ 0x000000001d49e9d2 11. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 12. /build/src/Server/HTTPHandler.h:94: DB::HTTPHandler::Output::finalize() @ 0x000000001d3ea829 13. /build/src/Server/HTTPHandler.cpp:970: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db33a 14. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.352362 [ 8522 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a09d07 4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0de47 5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022894827 6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a416b 7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x00000000228a2b09 8. /build/base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::peerAddress() @ 0x00000000228a6a1e 9. /build/base/poco/Net/include/Poco/Net/Socket.h:596: Poco::Net::Socket::peerAddress() const @ 0x00000000133cec28 10. /build/base/poco/Net/src/HTTPServerSession.cpp:65: Poco::Net::HTTPServerSession::clientAddress() @ 0x00000000228831b0 11. /build/src/Server/HTTP/HTTPServerRequest.cpp:34: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&, StrongTypedef const&) @ 0x000000001d4968f9 12. /build/src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x000000001d49595c 13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 18. ? @ 0x00007f713a222ac3 19. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.352430 [ 8519 ] {aa9f51a3-84de-4c6d-bad1-e7dddcd16c74} DynamicQueryHandler: Cannot flush data to client (after sending exception): Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:56288). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:184: DB::WriteBufferFromHTTPServerResponse::finalizeImpl() @ 0x000000001d49e9d2 11. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 12. /build/src/Server/HTTPHandler.h:94: DB::HTTPHandler::Output::finalize() @ 0x000000001d3ea829 13. /build/src/Server/HTTPHandler.cpp:970: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db33a 14. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.351904 [ 8550 ] {78fde84f-e8ea-462b-a071-9bcabf0bc1f9} DynamicQueryHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:42350): While executing TabSeparatedRowOutputFormat. (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:111: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e37c 11. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 12. /build/src/Processors/Formats/IOutputFormat.cpp:111: DB::IOutputFormat::flush() @ 0x000000001d547b9c 13. /build/src/Processors/Formats/IOutputFormat.cpp:0: DB::IOutputFormat::work() @ 0x000000001d5478f4 14. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d533be3 15. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d533920 16. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001d515ea1 17. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d516237 18. /build/src/Processors/Executors/PipelineExecutor.cpp:411: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d514ed5 19. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5142b6 20. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5122c8 21. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, DB::QueryFlags, std::optional const&, std::function) @ 0x000000001bbb6420 22. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&, StrongTypedef const&) @ 0x000000001d3da489 23. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3dd570 24. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 25. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 26. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 27. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 28. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 29. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 30. ? @ 0x00007f713a222ac3 31. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.352711 [ 8555 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a09d07 4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0de47 5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022894827 6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a416b 7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x00000000228a2b09 8. /build/base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::peerAddress() @ 0x00000000228a6a1e 9. /build/base/poco/Net/include/Poco/Net/Socket.h:596: Poco::Net::Socket::peerAddress() const @ 0x00000000133cec28 10. /build/base/poco/Net/src/HTTPServerSession.cpp:65: Poco::Net::HTTPServerSession::clientAddress() @ 0x00000000228831b0 11. /build/src/Server/HTTP/HTTPServerRequest.cpp:34: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&, StrongTypedef const&) @ 0x000000001d4968f9 12. /build/src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x000000001d49595c 13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 18. ? @ 0x00007f713a222ac3 19. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.353046 [ 8507 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a09d07 4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0de47 5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022894827 6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a416b 7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x00000000228a2b09 8. /build/base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::peerAddress() @ 0x00000000228a6a1e 9. /build/base/poco/Net/include/Poco/Net/Socket.h:596: Poco::Net::Socket::peerAddress() const @ 0x00000000133cec28 10. /build/base/poco/Net/src/HTTPServerSession.cpp:65: Poco::Net::HTTPServerSession::clientAddress() @ 0x00000000228831b0 11. /build/src/Server/HTTP/HTTPServerRequest.cpp:34: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&, StrongTypedef const&) @ 0x000000001d4968f9 12. /build/src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x000000001d49595c 13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 18. ? @ 0x00007f713a222ac3 19. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.353303 [ 8550 ] {78fde84f-e8ea-462b-a071-9bcabf0bc1f9} DynamicQueryHandler: Cannot send exception to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:42350). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/HTTPServerResponse.h:164: DB::HTTPWriteBuffer::nextImplChunked() @ 0x000000001d49ee29 8. /build/src/Server/HTTP/HTTPServerResponse.h:135: DB::HTTPWriteBuffer::nextImpl() @ 0x000000001d49eaef 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:116: DB::WriteBufferFromHTTPServerResponse::nextImpl() @ 0x000000001d49e3bf 10. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 11. /build/src/Server/HTTPHandler.cpp:955: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db57f 12. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 13. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 14. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 15. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 16. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 17. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 18. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 19. ? @ 0x00007f713a222ac3 20. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.353523 [ 8505 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a09d07 4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0de47 5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022894827 6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a416b 7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x00000000228a2b09 8. /build/base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::peerAddress() @ 0x00000000228a6a1e 9. /build/base/poco/Net/include/Poco/Net/Socket.h:596: Poco::Net::Socket::peerAddress() const @ 0x00000000133cec28 10. /build/base/poco/Net/src/HTTPServerSession.cpp:65: Poco::Net::HTTPServerSession::clientAddress() @ 0x00000000228831b0 11. /build/src/Server/HTTP/HTTPServerRequest.cpp:34: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&, StrongTypedef const&) @ 0x000000001d4968f9 12. /build/src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x000000001d49595c 13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 18. ? @ 0x00007f713a222ac3 19. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.353905 [ 8530 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a09d07 4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0de47 5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022894827 6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a416b 7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x00000000228a2b09 8. /build/base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::peerAddress() @ 0x00000000228a6a1e 9. /build/base/poco/Net/include/Poco/Net/Socket.h:596: Poco::Net::Socket::peerAddress() const @ 0x00000000133cec28 10. /build/base/poco/Net/src/HTTPServerSession.cpp:65: Poco::Net::HTTPServerSession::clientAddress() @ 0x00000000228831b0 11. /build/src/Server/HTTP/HTTPServerRequest.cpp:34: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&, StrongTypedef const&) @ 0x000000001d4968f9 12. /build/src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x000000001d49595c 13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 18. ? @ 0x00007f713a222ac3 19. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.353913 [ 8550 ] {78fde84f-e8ea-462b-a071-9bcabf0bc1f9} DynamicQueryHandler: Cannot flush data to client (after sending exception): Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:8123 -> [::1]:42350). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:116: DB::WriteBufferFromPocoSocket::socketSendBytes(char const*, unsigned long) @ 0x00000000134e7fc4 7. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:51: DB::WriteBufferFromHTTPServerResponse::writeHeaderProgressImpl(char const*) @ 0x000000001d49df6d 8. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:60: DB::WriteBufferFromHTTPServerResponse::writeHeaderSummary() @ 0x000000001d49e089 9. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:88: DB::WriteBufferFromHTTPServerResponse::finishSendHeaders() @ 0x000000001d49e22e 10. /build/src/Server/HTTP/WriteBufferFromHTTPServerResponse.cpp:184: DB::WriteBufferFromHTTPServerResponse::finalizeImpl() @ 0x000000001d49e9d2 11. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a928862 12. /build/src/Server/HTTPHandler.h:94: DB::HTTPHandler::Output::finalize() @ 0x000000001d3ea829 13. /build/src/Server/HTTPHandler.cpp:970: DB::HTTPHandler::trySendExceptionToClient(String const&, int, DB::HTTPServerRequest&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&) @ 0x000000001d3db33a 14. /build/src/Server/HTTPHandler.cpp:1120: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef const&) @ 0x000000001d3de7bf 15. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d495fc7 16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 21. ? @ 0x00007f713a222ac3 22. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.354393 [ 2758 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a09d07 4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0de47 5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022894827 6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a416b 7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x00000000228a2b09 8. /build/base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::peerAddress() @ 0x00000000228a6a1e 9. /build/base/poco/Net/include/Poco/Net/Socket.h:596: Poco::Net::Socket::peerAddress() const @ 0x00000000133cec28 10. /build/base/poco/Net/src/HTTPServerSession.cpp:65: Poco::Net::HTTPServerSession::clientAddress() @ 0x00000000228831b0 11. /build/src/Server/HTTP/HTTPServerRequest.cpp:34: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&, StrongTypedef const&) @ 0x000000001d4968f9 12. /build/src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x000000001d49595c 13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 18. ? @ 0x00007f713a222ac3 19. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.354961 [ 8523 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a09d07 4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0de47 5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022894827 6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a416b 7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x00000000228a2b09 8. /build/base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::peerAddress() @ 0x00000000228a6a1e 9. /build/base/poco/Net/include/Poco/Net/Socket.h:596: Poco::Net::Socket::peerAddress() const @ 0x00000000133cec28 10. /build/base/poco/Net/src/HTTPServerSession.cpp:65: Poco::Net::HTTPServerSession::clientAddress() @ 0x00000000228831b0 11. /build/src/Server/HTTP/HTTPServerRequest.cpp:34: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&, StrongTypedef const&) @ 0x000000001d4968f9 12. /build/src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x000000001d49595c 13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 18. ? @ 0x00007f713a222ac3 19. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.355440 [ 8541 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a09d07 4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0de47 5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022894827 6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a416b 7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x00000000228a2b09 8. /build/base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::peerAddress() @ 0x00000000228a6a1e 9. /build/base/poco/Net/include/Poco/Net/Socket.h:596: Poco::Net::Socket::peerAddress() const @ 0x00000000133cec28 10. /build/base/poco/Net/src/HTTPServerSession.cpp:65: Poco::Net::HTTPServerSession::clientAddress() @ 0x00000000228831b0 11. /build/src/Server/HTTP/HTTPServerRequest.cpp:34: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&, StrongTypedef const&) @ 0x000000001d4968f9 12. /build/src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x000000001d49595c 13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 18. ? @ 0x00007f713a222ac3 19. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.355881 [ 8565 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a09d07 4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0de47 5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022894827 6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a416b 7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x00000000228a2b09 8. /build/base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::peerAddress() @ 0x00000000228a6a1e 9. /build/base/poco/Net/include/Poco/Net/Socket.h:596: Poco::Net::Socket::peerAddress() const @ 0x00000000133cec28 10. /build/base/poco/Net/src/HTTPServerSession.cpp:65: Poco::Net::HTTPServerSession::clientAddress() @ 0x00000000228831b0 11. /build/src/Server/HTTP/HTTPServerRequest.cpp:34: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&, StrongTypedef const&) @ 0x000000001d4968f9 12. /build/src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x000000001d49595c 13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 18. ? @ 0x00007f713a222ac3 19. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.356325 [ 8566 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a09d07 4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0de47 5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022894827 6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a416b 7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x00000000228a2b09 8. /build/base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::peerAddress() @ 0x00000000228a6a1e 9. /build/base/poco/Net/include/Poco/Net/Socket.h:596: Poco::Net::Socket::peerAddress() const @ 0x00000000133cec28 10. /build/base/poco/Net/src/HTTPServerSession.cpp:65: Poco::Net::HTTPServerSession::clientAddress() @ 0x00000000228831b0 11. /build/src/Server/HTTP/HTTPServerRequest.cpp:34: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&, StrongTypedef const&) @ 0x000000001d4968f9 12. /build/src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x000000001d49595c 13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 18. ? @ 0x00007f713a222ac3 19. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.356799 [ 8557 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a09d07 4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0de47 5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022894827 6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a416b 7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x00000000228a2b09 8. /build/base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::peerAddress() @ 0x00000000228a6a1e 9. /build/base/poco/Net/include/Poco/Net/Socket.h:596: Poco::Net::Socket::peerAddress() const @ 0x00000000133cec28 10. /build/base/poco/Net/src/HTTPServerSession.cpp:65: Poco::Net::HTTPServerSession::clientAddress() @ 0x00000000228831b0 11. /build/src/Server/HTTP/HTTPServerRequest.cpp:34: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&, StrongTypedef const&) @ 0x000000001d4968f9 12. /build/src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x000000001d49595c 13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 18. ? @ 0x00007f713a222ac3 19. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.357224 [ 3868 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a09d07 4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0de47 5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022894827 6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a416b 7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x00000000228a2b09 8. /build/base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::peerAddress() @ 0x00000000228a6a1e 9. /build/base/poco/Net/include/Poco/Net/Socket.h:596: Poco::Net::Socket::peerAddress() const @ 0x00000000133cec28 10. /build/base/poco/Net/src/HTTPServerSession.cpp:65: Poco::Net::HTTPServerSession::clientAddress() @ 0x00000000228831b0 11. /build/src/Server/HTTP/HTTPServerRequest.cpp:34: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&, StrongTypedef const&) @ 0x000000001d4968f9 12. /build/src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x000000001d49595c 13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 18. ? @ 0x00007f713a222ac3 19. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.357555 [ 8517 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a09d07 4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0de47 5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022894827 6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a416b 7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x00000000228a2b09 8. /build/base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::peerAddress() @ 0x00000000228a6a1e 9. /build/base/poco/Net/include/Poco/Net/Socket.h:596: Poco::Net::Socket::peerAddress() const @ 0x00000000133cec28 10. /build/base/poco/Net/src/HTTPServerSession.cpp:65: Poco::Net::HTTPServerSession::clientAddress() @ 0x00000000228831b0 11. /build/src/Server/HTTP/HTTPServerRequest.cpp:34: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&, StrongTypedef const&) @ 0x000000001d4968f9 12. /build/src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x000000001d49595c 13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 18. ? @ 0x00007f713a222ac3 19. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.357994 [ 8546 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a09d07 4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0de47 5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022894827 6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a416b 7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x00000000228a2b09 8. /build/base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::peerAddress() @ 0x00000000228a6a1e 9. /build/base/poco/Net/include/Poco/Net/Socket.h:596: Poco::Net::Socket::peerAddress() const @ 0x00000000133cec28 10. /build/base/poco/Net/src/HTTPServerSession.cpp:65: Poco::Net::HTTPServerSession::clientAddress() @ 0x00000000228831b0 11. /build/src/Server/HTTP/HTTPServerRequest.cpp:34: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&, StrongTypedef const&) @ 0x000000001d4968f9 12. /build/src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x000000001d49595c 13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 18. ? @ 0x00007f713a222ac3 19. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.361899 [ 5023 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a09d07 4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0de47 5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022894827 6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a416b 7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x00000000228a2b09 8. /build/base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::peerAddress() @ 0x00000000228a6a1e 9. /build/base/poco/Net/include/Poco/Net/Socket.h:596: Poco::Net::Socket::peerAddress() const @ 0x00000000133cec28 10. /build/base/poco/Net/src/HTTPServerSession.cpp:65: Poco::Net::HTTPServerSession::clientAddress() @ 0x00000000228831b0 11. /build/src/Server/HTTP/HTTPServerRequest.cpp:34: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&, StrongTypedef const&) @ 0x000000001d4968f9 12. /build/src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x000000001d49595c 13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 18. ? @ 0x00007f713a222ac3 19. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.362615 [ 8529 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a09d07 4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0de47 5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022894827 6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a416b 7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x00000000228a2b09 8. /build/base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::peerAddress() @ 0x00000000228a6a1e 9. /build/base/poco/Net/include/Poco/Net/Socket.h:596: Poco::Net::Socket::peerAddress() const @ 0x00000000133cec28 10. /build/base/poco/Net/src/HTTPServerSession.cpp:65: Poco::Net::HTTPServerSession::clientAddress() @ 0x00000000228831b0 11. /build/src/Server/HTTP/HTTPServerRequest.cpp:34: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&, StrongTypedef const&) @ 0x000000001d4968f9 12. /build/src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x000000001d49595c 13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 18. ? @ 0x00007f713a222ac3 19. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.362992 [ 8515 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a09d07 4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0de47 5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022894827 6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a416b 7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x00000000228a2b09 8. /build/base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::peerAddress() @ 0x00000000228a6a1e 9. /build/base/poco/Net/include/Poco/Net/Socket.h:596: Poco::Net::Socket::peerAddress() const @ 0x00000000133cec28 10. /build/base/poco/Net/src/HTTPServerSession.cpp:65: Poco::Net::HTTPServerSession::clientAddress() @ 0x00000000228831b0 11. /build/src/Server/HTTP/HTTPServerRequest.cpp:34: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&, StrongTypedef const&) @ 0x000000001d4968f9 12. /build/src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x000000001d49595c 13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 18. ? @ 0x00007f713a222ac3 19. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.363381 [ 8521 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a09d07 4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0de47 5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022894827 6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a416b 7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x00000000228a2b09 8. /build/base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::peerAddress() @ 0x00000000228a6a1e 9. /build/base/poco/Net/include/Poco/Net/Socket.h:596: Poco::Net::Socket::peerAddress() const @ 0x00000000133cec28 10. /build/base/poco/Net/src/HTTPServerSession.cpp:65: Poco::Net::HTTPServerSession::clientAddress() @ 0x00000000228831b0 11. /build/src/Server/HTTP/HTTPServerRequest.cpp:34: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&, StrongTypedef const&) @ 0x000000001d4968f9 12. /build/src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x000000001d49595c 13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 18. ? @ 0x00007f713a222ac3 19. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.363757 [ 8552 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a09d07 4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0de47 5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022894827 6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a416b 7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x00000000228a2b09 8. /build/base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::peerAddress() @ 0x00000000228a6a1e 9. /build/base/poco/Net/include/Poco/Net/Socket.h:596: Poco::Net::Socket::peerAddress() const @ 0x00000000133cec28 10. /build/base/poco/Net/src/HTTPServerSession.cpp:65: Poco::Net::HTTPServerSession::clientAddress() @ 0x00000000228831b0 11. /build/src/Server/HTTP/HTTPServerRequest.cpp:34: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&, StrongTypedef const&) @ 0x000000001d4968f9 12. /build/src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x000000001d49595c 13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 18. ? @ 0x00007f713a222ac3 19. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.364174 [ 8540 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a09d07 4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0de47 5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022894827 6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a416b 7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x00000000228a2b09 8. /build/base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::peerAddress() @ 0x00000000228a6a1e 9. /build/base/poco/Net/include/Poco/Net/Socket.h:596: Poco::Net::Socket::peerAddress() const @ 0x00000000133cec28 10. /build/base/poco/Net/src/HTTPServerSession.cpp:65: Poco::Net::HTTPServerSession::clientAddress() @ 0x00000000228831b0 11. /build/src/Server/HTTP/HTTPServerRequest.cpp:34: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&, StrongTypedef const&) @ 0x000000001d4968f9 12. /build/src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x000000001d49595c 13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 18. ? @ 0x00007f713a222ac3 19. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.364594 [ 8560 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a09d07 4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0de47 5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022894827 6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a416b 7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x00000000228a2b09 8. /build/base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::peerAddress() @ 0x00000000228a6a1e 9. /build/base/poco/Net/include/Poco/Net/Socket.h:596: Poco::Net::Socket::peerAddress() const @ 0x00000000133cec28 10. /build/base/poco/Net/src/HTTPServerSession.cpp:65: Poco::Net::HTTPServerSession::clientAddress() @ 0x00000000228831b0 11. /build/src/Server/HTTP/HTTPServerRequest.cpp:34: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&, StrongTypedef const&) @ 0x000000001d4968f9 12. /build/src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x000000001d49595c 13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 18. ? @ 0x00007f713a222ac3 19. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.365089 [ 8553 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a09d07 4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0de47 5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022894827 6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a416b 7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x00000000228a2b09 8. /build/base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::peerAddress() @ 0x00000000228a6a1e 9. /build/base/poco/Net/include/Poco/Net/Socket.h:596: Poco::Net::Socket::peerAddress() const @ 0x00000000133cec28 10. /build/base/poco/Net/src/HTTPServerSession.cpp:65: Poco::Net::HTTPServerSession::clientAddress() @ 0x00000000228831b0 11. /build/src/Server/HTTP/HTTPServerRequest.cpp:34: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&, StrongTypedef const&) @ 0x000000001d4968f9 12. /build/src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x000000001d49595c 13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 18. ? @ 0x00007f713a222ac3 19. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.365528 [ 8527 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a09d07 4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0de47 5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022894827 6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a416b 7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x00000000228a2b09 8. /build/base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::peerAddress() @ 0x00000000228a6a1e 9. /build/base/poco/Net/include/Poco/Net/Socket.h:596: Poco::Net::Socket::peerAddress() const @ 0x00000000133cec28 10. /build/base/poco/Net/src/HTTPServerSession.cpp:65: Poco::Net::HTTPServerSession::clientAddress() @ 0x00000000228831b0 11. /build/src/Server/HTTP/HTTPServerRequest.cpp:34: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&, StrongTypedef const&) @ 0x000000001d4968f9 12. /build/src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x000000001d49595c 13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 18. ? @ 0x00007f713a222ac3 19. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.365927 [ 8562 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a09d07 4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0de47 5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022894827 6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a416b 7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x00000000228a2b09 8. /build/base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::peerAddress() @ 0x00000000228a6a1e 9. /build/base/poco/Net/include/Poco/Net/Socket.h:596: Poco::Net::Socket::peerAddress() const @ 0x00000000133cec28 10. /build/base/poco/Net/src/HTTPServerSession.cpp:65: Poco::Net::HTTPServerSession::clientAddress() @ 0x00000000228831b0 11. /build/src/Server/HTTP/HTTPServerRequest.cpp:34: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&, StrongTypedef const&) @ 0x000000001d4968f9 12. /build/src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x000000001d49595c 13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 18. ? @ 0x00007f713a222ac3 19. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.366339 [ 8518 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a09d07 4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0de47 5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022894827 6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a416b 7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x00000000228a2b09 8. /build/base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::peerAddress() @ 0x00000000228a6a1e 9. /build/base/poco/Net/include/Poco/Net/Socket.h:596: Poco::Net::Socket::peerAddress() const @ 0x00000000133cec28 10. /build/base/poco/Net/src/HTTPServerSession.cpp:65: Poco::Net::HTTPServerSession::clientAddress() @ 0x00000000228831b0 11. /build/src/Server/HTTP/HTTPServerRequest.cpp:34: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&, StrongTypedef const&) @ 0x000000001d4968f9 12. /build/src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x000000001d49595c 13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 18. ? @ 0x00007f713a222ac3 19. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.366707 [ 8564 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a09d07 4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0de47 5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022894827 6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a416b 7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x00000000228a2b09 8. /build/base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::peerAddress() @ 0x00000000228a6a1e 9. /build/base/poco/Net/include/Poco/Net/Socket.h:596: Poco::Net::Socket::peerAddress() const @ 0x00000000133cec28 10. /build/base/poco/Net/src/HTTPServerSession.cpp:65: Poco::Net::HTTPServerSession::clientAddress() @ 0x00000000228831b0 11. /build/src/Server/HTTP/HTTPServerRequest.cpp:34: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&, StrongTypedef const&) @ 0x000000001d4968f9 12. /build/src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x000000001d49595c 13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 18. ? @ 0x00007f713a222ac3 19. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.367131 [ 8549 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a09d07 4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0de47 5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022894827 6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a416b 7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x00000000228a2b09 8. /build/base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::peerAddress() @ 0x00000000228a6a1e 9. /build/base/poco/Net/include/Poco/Net/Socket.h:596: Poco::Net::Socket::peerAddress() const @ 0x00000000133cec28 10. /build/base/poco/Net/src/HTTPServerSession.cpp:65: Poco::Net::HTTPServerSession::clientAddress() @ 0x00000000228831b0 11. /build/src/Server/HTTP/HTTPServerRequest.cpp:34: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&, StrongTypedef const&) @ 0x000000001d4968f9 12. /build/src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x000000001d49595c 13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 18. ? @ 0x00007f713a222ac3 19. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.371028 [ 8563 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a09d07 4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0de47 5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022894827 6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a416b 7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x00000000228a2b09 8. /build/base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::peerAddress() @ 0x00000000228a6a1e 9. /build/base/poco/Net/include/Poco/Net/Socket.h:596: Poco::Net::Socket::peerAddress() const @ 0x00000000133cec28 10. /build/base/poco/Net/src/HTTPServerSession.cpp:65: Poco::Net::HTTPServerSession::clientAddress() @ 0x00000000228831b0 11. /build/src/Server/HTTP/HTTPServerRequest.cpp:34: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&, StrongTypedef const&) @ 0x000000001d4968f9 12. /build/src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x000000001d49595c 13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 18. ? @ 0x00007f713a222ac3 19. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.371378 [ 8539 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a09d07 4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0de47 5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022894827 6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a416b 7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x00000000228a2b09 8. /build/base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::peerAddress() @ 0x00000000228a6a1e 9. /build/base/poco/Net/include/Poco/Net/Socket.h:596: Poco::Net::Socket::peerAddress() const @ 0x00000000133cec28 10. /build/base/poco/Net/src/HTTPServerSession.cpp:65: Poco::Net::HTTPServerSession::clientAddress() @ 0x00000000228831b0 11. /build/src/Server/HTTP/HTTPServerRequest.cpp:34: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&, StrongTypedef const&) @ 0x000000001d4968f9 12. /build/src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x000000001d49595c 13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 18. ? @ 0x00007f713a222ac3 19. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.371710 [ 8520 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a09d07 4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0de47 5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022894827 6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a416b 7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x00000000228a2b09 8. /build/base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::peerAddress() @ 0x00000000228a6a1e 9. /build/base/poco/Net/include/Poco/Net/Socket.h:596: Poco::Net::Socket::peerAddress() const @ 0x00000000133cec28 10. /build/base/poco/Net/src/HTTPServerSession.cpp:65: Poco::Net::HTTPServerSession::clientAddress() @ 0x00000000228831b0 11. /build/src/Server/HTTP/HTTPServerRequest.cpp:34: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&, StrongTypedef const&) @ 0x000000001d4968f9 12. /build/src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x000000001d49595c 13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 18. ? @ 0x00007f713a222ac3 19. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.372073 [ 8524 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a09d07 4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0de47 5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022894827 6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a416b 7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x00000000228a2b09 8. /build/base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::peerAddress() @ 0x00000000228a6a1e 9. /build/base/poco/Net/include/Poco/Net/Socket.h:596: Poco::Net::Socket::peerAddress() const @ 0x00000000133cec28 10. /build/base/poco/Net/src/HTTPServerSession.cpp:65: Poco::Net::HTTPServerSession::clientAddress() @ 0x00000000228831b0 11. /build/src/Server/HTTP/HTTPServerRequest.cpp:34: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&, StrongTypedef const&) @ 0x000000001d4968f9 12. /build/src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x000000001d49595c 13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 18. ? @ 0x00007f713a222ac3 19. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.372445 [ 8543 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a09d07 4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0de47 5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022894827 6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a416b 7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x00000000228a2b09 8. /build/base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::peerAddress() @ 0x00000000228a6a1e 9. /build/base/poco/Net/include/Poco/Net/Socket.h:596: Poco::Net::Socket::peerAddress() const @ 0x00000000133cec28 10. /build/base/poco/Net/src/HTTPServerSession.cpp:65: Poco::Net::HTTPServerSession::clientAddress() @ 0x00000000228831b0 11. /build/src/Server/HTTP/HTTPServerRequest.cpp:34: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&, StrongTypedef const&) @ 0x000000001d4968f9 12. /build/src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x000000001d49595c 13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 18. ? @ 0x00007f713a222ac3 19. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.372817 [ 8508 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a09d07 4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0de47 5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022894827 6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a416b 7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x00000000228a2b09 8. /build/base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::peerAddress() @ 0x00000000228a6a1e 9. /build/base/poco/Net/include/Poco/Net/Socket.h:596: Poco::Net::Socket::peerAddress() const @ 0x00000000133cec28 10. /build/base/poco/Net/src/HTTPServerSession.cpp:65: Poco::Net::HTTPServerSession::clientAddress() @ 0x00000000228831b0 11. /build/src/Server/HTTP/HTTPServerRequest.cpp:34: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&, StrongTypedef const&) @ 0x000000001d4968f9 12. /build/src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x000000001d49595c 13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 18. ? @ 0x00007f713a222ac3 19. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.373186 [ 8545 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a09d07 4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0de47 5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022894827 6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a416b 7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x00000000228a2b09 8. /build/base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::peerAddress() @ 0x00000000228a6a1e 9. /build/base/poco/Net/include/Poco/Net/Socket.h:596: Poco::Net::Socket::peerAddress() const @ 0x00000000133cec28 10. /build/base/poco/Net/src/HTTPServerSession.cpp:65: Poco::Net::HTTPServerSession::clientAddress() @ 0x00000000228831b0 11. /build/src/Server/HTTP/HTTPServerRequest.cpp:34: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&, StrongTypedef const&) @ 0x000000001d4968f9 12. /build/src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x000000001d49595c 13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 18. ? @ 0x00007f713a222ac3 19. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.373522 [ 8526 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a09d07 4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0de47 5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022894827 6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a416b 7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x00000000228a2b09 8. /build/base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::peerAddress() @ 0x00000000228a6a1e 9. /build/base/poco/Net/include/Poco/Net/Socket.h:596: Poco::Net::Socket::peerAddress() const @ 0x00000000133cec28 10. /build/base/poco/Net/src/HTTPServerSession.cpp:65: Poco::Net::HTTPServerSession::clientAddress() @ 0x00000000228831b0 11. /build/src/Server/HTTP/HTTPServerRequest.cpp:34: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&, StrongTypedef const&) @ 0x000000001d4968f9 12. /build/src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x000000001d49595c 13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 18. ? @ 0x00007f713a222ac3 19. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.373915 [ 8506 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a09d07 4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0de47 5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022894827 6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a416b 7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x00000000228a2b09 8. /build/base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::peerAddress() @ 0x00000000228a6a1e 9. /build/base/poco/Net/include/Poco/Net/Socket.h:596: Poco::Net::Socket::peerAddress() const @ 0x00000000133cec28 10. /build/base/poco/Net/src/HTTPServerSession.cpp:65: Poco::Net::HTTPServerSession::clientAddress() @ 0x00000000228831b0 11. /build/src/Server/HTTP/HTTPServerRequest.cpp:34: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&, StrongTypedef const&) @ 0x000000001d4968f9 12. /build/src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x000000001d49595c 13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 18. ? @ 0x00007f713a222ac3 19. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.374362 [ 8548 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a09d07 4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0de47 5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022894827 6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a416b 7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x00000000228a2b09 8. /build/base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::peerAddress() @ 0x00000000228a6a1e 9. /build/base/poco/Net/include/Poco/Net/Socket.h:596: Poco::Net::Socket::peerAddress() const @ 0x00000000133cec28 10. /build/base/poco/Net/src/HTTPServerSession.cpp:65: Poco::Net::HTTPServerSession::clientAddress() @ 0x00000000228831b0 11. /build/src/Server/HTTP/HTTPServerRequest.cpp:34: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&, StrongTypedef const&) @ 0x000000001d4968f9 12. /build/src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x000000001d49595c 13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 18. ? @ 0x00007f713a222ac3 19. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.374952 [ 8554 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a09d07 4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0de47 5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022894827 6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a416b 7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x00000000228a2b09 8. /build/base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::peerAddress() @ 0x00000000228a6a1e 9. /build/base/poco/Net/include/Poco/Net/Socket.h:596: Poco::Net::Socket::peerAddress() const @ 0x00000000133cec28 10. /build/base/poco/Net/src/HTTPServerSession.cpp:65: Poco::Net::HTTPServerSession::clientAddress() @ 0x00000000228831b0 11. /build/src/Server/HTTP/HTTPServerRequest.cpp:34: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&, StrongTypedef const&) @ 0x000000001d4968f9 12. /build/src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x000000001d49595c 13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 18. ? @ 0x00007f713a222ac3 19. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.375356 [ 3855 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a09d07 4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0de47 5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022894827 6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a416b 7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x00000000228a2b09 8. /build/base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::peerAddress() @ 0x00000000228a6a1e 9. /build/base/poco/Net/include/Poco/Net/Socket.h:596: Poco::Net::Socket::peerAddress() const @ 0x00000000133cec28 10. /build/base/poco/Net/src/HTTPServerSession.cpp:65: Poco::Net::HTTPServerSession::clientAddress() @ 0x00000000228831b0 11. /build/src/Server/HTTP/HTTPServerRequest.cpp:34: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&, StrongTypedef const&) @ 0x000000001d4968f9 12. /build/src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x000000001d49595c 13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 18. ? @ 0x00007f713a222ac3 19. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.375773 [ 8551 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a09d07 4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0de47 5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022894827 6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a416b 7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x00000000228a2b09 8. /build/base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::peerAddress() @ 0x00000000228a6a1e 9. /build/base/poco/Net/include/Poco/Net/Socket.h:596: Poco::Net::Socket::peerAddress() const @ 0x00000000133cec28 10. /build/base/poco/Net/src/HTTPServerSession.cpp:65: Poco::Net::HTTPServerSession::clientAddress() @ 0x00000000228831b0 11. /build/src/Server/HTTP/HTTPServerRequest.cpp:34: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&, StrongTypedef const&) @ 0x000000001d4968f9 12. /build/src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x000000001d49595c 13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 18. ? @ 0x00007f713a222ac3 19. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.376218 [ 8531 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a09d07 4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0de47 5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022894827 6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a416b 7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x00000000228a2b09 8. /build/base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::peerAddress() @ 0x00000000228a6a1e 9. /build/base/poco/Net/include/Poco/Net/Socket.h:596: Poco::Net::Socket::peerAddress() const @ 0x00000000133cec28 10. /build/base/poco/Net/src/HTTPServerSession.cpp:65: Poco::Net::HTTPServerSession::clientAddress() @ 0x00000000228831b0 11. /build/src/Server/HTTP/HTTPServerRequest.cpp:34: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&, StrongTypedef const&) @ 0x000000001d4968f9 12. /build/src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x000000001d49595c 13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 18. ? @ 0x00007f713a222ac3 19. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.376593 [ 8512 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a09d07 4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0de47 5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022894827 6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a416b 7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x00000000228a2b09 8. /build/base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::peerAddress() @ 0x00000000228a6a1e 9. /build/base/poco/Net/include/Poco/Net/Socket.h:596: Poco::Net::Socket::peerAddress() const @ 0x00000000133cec28 10. /build/base/poco/Net/src/HTTPServerSession.cpp:65: Poco::Net::HTTPServerSession::clientAddress() @ 0x00000000228831b0 11. /build/src/Server/HTTP/HTTPServerRequest.cpp:34: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&, StrongTypedef const&) @ 0x000000001d4968f9 12. /build/src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x000000001d49595c 13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 18. ? @ 0x00007f713a222ac3 19. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.377016 [ 8525 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a09d07 4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0de47 5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022894827 6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a416b 7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x00000000228a2b09 8. /build/base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::peerAddress() @ 0x00000000228a6a1e 9. /build/base/poco/Net/include/Poco/Net/Socket.h:596: Poco::Net::Socket::peerAddress() const @ 0x00000000133cec28 10. /build/base/poco/Net/src/HTTPServerSession.cpp:65: Poco::Net::HTTPServerSession::clientAddress() @ 0x00000000228831b0 11. /build/src/Server/HTTP/HTTPServerRequest.cpp:34: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&, StrongTypedef const&) @ 0x000000001d4968f9 12. /build/src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x000000001d49595c 13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 18. ? @ 0x00007f713a222ac3 19. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.377367 [ 8519 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a09d07 4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0de47 5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022894827 6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a416b 7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x00000000228a2b09 8. /build/base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::peerAddress() @ 0x00000000228a6a1e 9. /build/base/poco/Net/include/Poco/Net/Socket.h:596: Poco::Net::Socket::peerAddress() const @ 0x00000000133cec28 10. /build/base/poco/Net/src/HTTPServerSession.cpp:65: Poco::Net::HTTPServerSession::clientAddress() @ 0x00000000228831b0 11. /build/src/Server/HTTP/HTTPServerRequest.cpp:34: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&, StrongTypedef const&) @ 0x000000001d4968f9 12. /build/src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x000000001d49595c 13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 18. ? @ 0x00007f713a222ac3 19. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.377700 [ 8550 ] {} ServerErrorHandler: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a09d07 4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0de47 5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022894827 6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a416b 7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x00000000228a2b09 8. /build/base/poco/Net/src/SocketImpl.cpp:0: Poco::Net::SocketImpl::peerAddress() @ 0x00000000228a6a1e 9. /build/base/poco/Net/include/Poco/Net/Socket.h:596: Poco::Net::Socket::peerAddress() const @ 0x00000000133cec28 10. /build/base/poco/Net/src/HTTPServerSession.cpp:65: Poco::Net::HTTPServerSession::clientAddress() @ 0x00000000228831b0 11. /build/src/Server/HTTP/HTTPServerRequest.cpp:34: DB::HTTPServerRequest::HTTPServerRequest(std::shared_ptr, DB::HTTPServerResponse&, Poco::Net::HTTPServerSession&, StrongTypedef const&) @ 0x000000001d4968f9 12. /build/src/Server/HTTP/HTTPServerConnection.cpp:35: DB::HTTPServerConnection::run() @ 0x000000001d49595c 13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 18. ? @ 0x00007f713a222ac3 19. ? @ 0x00007f713a2b4850 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.471194 [ 3173 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:47.805750 [ 2756 ] {22c7d7b1-2637-42ee-985f-da81c9200e0e} executeQuery: Code: 159. DB::Exception: Code: 159. DB::Exception: Timeout exceeded (180 s) while flushing system log 'DB::SystemLogQueue'. (TIMEOUT_EXCEEDED) (version 24.3.12.76.altinitystable). (TIMEOUT_EXCEEDED) (version 24.3.12.76.altinitystable) (from [::1]:34114) (comment: 00177_memory_bound_merging.sh) (in query: SYSTEM FLUSH LOGS;), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:89: DB::Exception::Exception(String const&, int, bool) @ 0x000000000a942caa 5. /build/src/Common/Exception.h:97: DB::Exception::createDeprecated(String const&, int, bool) @ 0x000000000a942c55 6. /build/src/Interpreters/InterpreterSystemQuery.cpp:151: DB::(anonymous namespace)::executeCommandsAndThrowIfError(std::vector, std::allocator>>) @ 0x000000001bbf53cb 7. /build/src/Interpreters/InterpreterSystemQuery.cpp:709: DB::InterpreterSystemQuery::execute() @ 0x000000001bbf1a09 8. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 9. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 10. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 11. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 12. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 13. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 14. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 15. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 16. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 17. ? @ 0x00007f713a222ac3 18. ? @ 0x00007f713a2b4850 2024.12.16 11:34:47.815539 [ 4402 ] {6ab6d50f-7af8-4344-9661-b0448b14e792} executeQuery: Code: 159. DB::Exception: Code: 159. DB::Exception: Timeout exceeded (180 s) while flushing system log 'DB::SystemLogQueue'. (TIMEOUT_EXCEEDED) (version 24.3.12.76.altinitystable). (TIMEOUT_EXCEEDED) (version 24.3.12.76.altinitystable) (from [::1]:54512) (comment: 02725_async_insert_table_setting.sh) (in query: SYSTEM FLUSH LOGS;), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:89: DB::Exception::Exception(String const&, int, bool) @ 0x000000000a942caa 5. /build/src/Common/Exception.h:97: DB::Exception::createDeprecated(String const&, int, bool) @ 0x000000000a942c55 6. /build/src/Interpreters/InterpreterSystemQuery.cpp:151: DB::(anonymous namespace)::executeCommandsAndThrowIfError(std::vector, std::allocator>>) @ 0x000000001bbf53cb 7. /build/src/Interpreters/InterpreterSystemQuery.cpp:709: DB::InterpreterSystemQuery::execute() @ 0x000000001bbf1a09 8. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 9. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 10. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 11. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 12. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 13. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 14. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 15. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 16. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 17. ? @ 0x00007f713a222ac3 18. ? @ 0x00007f713a2b4850 2024.12.16 11:34:47.816574 [ 2756 ] {22c7d7b1-2637-42ee-985f-da81c9200e0e} TCPHandler: Code: 159. DB::Exception: Code: 159. DB::Exception: Timeout exceeded (180 s) while flushing system log 'DB::SystemLogQueue'. (TIMEOUT_EXCEEDED) (version 24.3.12.76.altinitystable). (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:89: DB::Exception::Exception(String const&, int, bool) @ 0x000000000a942caa 5. /build/src/Common/Exception.h:97: DB::Exception::createDeprecated(String const&, int, bool) @ 0x000000000a942c55 6. /build/src/Interpreters/InterpreterSystemQuery.cpp:151: DB::(anonymous namespace)::executeCommandsAndThrowIfError(std::vector, std::allocator>>) @ 0x000000001bbf53cb 7. /build/src/Interpreters/InterpreterSystemQuery.cpp:709: DB::InterpreterSystemQuery::execute() @ 0x000000001bbf1a09 8. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 9. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 10. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 11. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 12. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 13. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 14. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 15. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 16. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 17. ? @ 0x00007f713a222ac3 18. ? @ 0x00007f713a2b4850 2024.12.16 11:34:47.817164 [ 2756 ] {22c7d7b1-2637-42ee-985f-da81c9200e0e} TCPHandler: Client has gone away. 2024.12.16 11:34:47.817222 [ 4402 ] {6ab6d50f-7af8-4344-9661-b0448b14e792} TCPHandler: Code: 159. DB::Exception: Code: 159. DB::Exception: Timeout exceeded (180 s) while flushing system log 'DB::SystemLogQueue'. (TIMEOUT_EXCEEDED) (version 24.3.12.76.altinitystable). (TIMEOUT_EXCEEDED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:89: DB::Exception::Exception(String const&, int, bool) @ 0x000000000a942caa 5. /build/src/Common/Exception.h:97: DB::Exception::createDeprecated(String const&, int, bool) @ 0x000000000a942c55 6. /build/src/Interpreters/InterpreterSystemQuery.cpp:151: DB::(anonymous namespace)::executeCommandsAndThrowIfError(std::vector, std::allocator>>) @ 0x000000001bbf53cb 7. /build/src/Interpreters/InterpreterSystemQuery.cpp:709: DB::InterpreterSystemQuery::execute() @ 0x000000001bbf1a09 8. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb26d7 9. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbac7aa 10. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46fe60 11. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 12. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 13. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 14. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 15. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 16. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 17. ? @ 0x00007f713a222ac3 18. ? @ 0x00007f713a2b4850 2024.12.16 11:34:47.817761 [ 4402 ] {6ab6d50f-7af8-4344-9661-b0448b14e792} TCPHandler: Client has gone away. 2024.12.16 11:34:48.308845 [ 3140 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3522: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000001c525e62 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:335: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_1::operator()() const @ 0x000000001c5bde58 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5bde35 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5bde15 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5bddf5 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5bddbd 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:48.472930 [ 3100 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:49.069875 [ 8528 ] {} BaseDaemon: 10. ? @ 0x000000000a8e1efe 2024.12.16 11:34:49.081801 [ 8528 ] {} BaseDaemon: 11. ? @ 0x000000001b64df68 2024.12.16 11:34:49.310001 [ 3057 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3522: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000001c525e62 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:335: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_1::operator()() const @ 0x000000001c5bde58 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5bde35 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5bde15 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5bddf5 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5bddbd 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:49.473811 [ 3045 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:49.568508 [ 8528 ] {} BaseDaemon: 12. /build/src/Interpreters/TransactionLog.cpp:469: DB::TransactionLog::finalizeCommittedTransaction(DB::MergeTreeTransaction*, unsigned long, BasicScopeGuard>&) @ 0x000000001ba812d1 2024.12.16 11:34:50.071803 [ 8528 ] {} BaseDaemon: 13. /build/src/Interpreters/TransactionLog.cpp:448: DB::TransactionLog::commitTransaction(std::shared_ptr const&, bool) @ 0x000000001ba85bf8 2024.12.16 11:34:50.276520 [ 8528 ] {} BaseDaemon: 14. /build/src/Interpreters/InterpreterTransactionControlQuery.cpp:68: DB::InterpreterTransactionControlQuery::executeCommit(std::shared_ptr) @ 0x000000001bbc50a9 2024.12.16 11:34:50.310935 [ 2982 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3522: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000001c525e62 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:335: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_1::operator()() const @ 0x000000001c5bde58 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5bde35 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5bde15 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5bddf5 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5bddbd 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:50.475090 [ 2976 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:50.498162 [ 8528 ] {} BaseDaemon: 15. /build/src/Interpreters/InterpreterTransactionControlQuery.cpp:30: DB::InterpreterTransactionControlQuery::execute() @ 0x000000001bbc4a5d 2024.12.16 11:34:51.020406 [ 8528 ] {} BaseDaemon: 16. /build/src/Interpreters/executeQuery.cpp:874: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*)::$_0::operator()(std::shared_ptr const&, DB::ASTTransactionControl::QueryType) const @ 0x000000001bbba3cb 2024.12.16 11:34:51.312092 [ 2927 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3522: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000001c525e62 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:335: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_1::operator()() const @ 0x000000001c5bde58 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5bde35 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5bde15 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5bddf5 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5bddbd 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:51.439542 [ 8528 ] {} BaseDaemon: 17. /build/src/Interpreters/executeQuery.cpp:1327: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*)::$_1::operator()(DB::QueryPipeline&) @ 0x000000001bbbadf1 2024.12.16 11:34:51.479607 [ 2918 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:51.883847 [ 8528 ] {} BaseDaemon: 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001bbbacdd 2024.12.16 11:34:52.282026 [ 8528 ] {} BaseDaemon: 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001bbbac9d 2024.12.16 11:34:52.313130 [ 2866 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3522: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000001c525e62 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:335: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_1::operator()() const @ 0x000000001c5bde58 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5bde35 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5bde15 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5bddf5 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5bddbd 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:52.480695 [ 2863 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:52.682249 [ 8528 ] {} BaseDaemon: 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001bbbac5d 2024.12.16 11:34:53.091127 [ 8528 ] {} BaseDaemon: 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001bbbac28 2024.12.16 11:34:53.147620 [ 8528 ] {} BaseDaemon: 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019e3ae5e 2024.12.16 11:34:53.198182 [ 8528 ] {} BaseDaemon: 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019e3a9bd 2024.12.16 11:34:53.250348 [ 8528 ] {} BaseDaemon: 24. /build/src/QueryPipeline/BlockIO.cpp:0: DB::BlockIO::onFinish() @ 0x0000000019e3a584 2024.12.16 11:34:53.314460 [ 3354 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3522: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000001c525e62 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:335: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_1::operator()() const @ 0x000000001c5bde58 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5bde35 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5bde15 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5bddf5 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5bddbd 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:53.490010 [ 3344 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:53.693364 [ 8528 ] {} BaseDaemon: 25. /build/src/Server/TCPHandler.cpp:528: DB::TCPHandler::runImpl()::$_8::operator()() const @ 0x000000001d47ab3c 2024.12.16 11:34:54.110386 [ 8528 ] {} BaseDaemon: 26. /build/src/Server/TCPHandler.cpp:535: DB::TCPHandler::runImpl() @ 0x000000001d46ff42 2024.12.16 11:34:54.315939 [ 3301 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3522: DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000001c525e62 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:335: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_1::operator()() const @ 0x000000001c5bde58 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5bde35 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5bde15 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5bddf5 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5bddbd 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:54.491093 [ 3295 ] {} test_8hof96gt.partitioned_table (cea6e92c-421d-4284-a242-8d0ffbc9b6c9): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/test_8hof96gt/01650_drop_part_and_deduplication_partitioned_table/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000a943033 6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4ace2e 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4acd2e 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52a90d 9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5be4b8 10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5be495 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5be475 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5be455 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5be41d 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993269d 17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019936106 18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0::operator()() const @ 0x0000000019937018 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936ff5 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019936fd9 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000], StrongTypedef, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&, std::tuple<>&) @ 0x0000000019936f3d 22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019936e65 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019936dd5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019936db5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019936d95 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019936d60 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 (version 24.3.12.76.altinitystable) 2024.12.16 11:34:54.584868 [ 8528 ] {} BaseDaemon: 27. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d4870c5 2024.12.16 11:34:54.603673 [ 8528 ] {} BaseDaemon: 28. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228aead9 2024.12.16 11:34:54.633515 [ 8528 ] {} BaseDaemon: 29. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228af328 2024.12.16 11:34:54.665267 [ 8528 ] {} BaseDaemon: 30. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a86654 2024.12.16 11:34:54.696438 [ 8528 ] {} BaseDaemon: 31. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a833fa 2024.12.16 11:34:54.725615 [ 8528 ] {} BaseDaemon: 32. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a8213e 2024.12.16 11:34:54.725964 [ 8528 ] {} BaseDaemon: 33. ? @ 0x00007f713a222ac3 2024.12.16 11:34:54.726226 [ 8528 ] {} BaseDaemon: 34. ? @ 0x00007f713a2b4850 2024.12.16 11:34:54.726489 [ 8528 ] {} BaseDaemon: Integrity check of the executable skipped because the reference checksum could not be read. 2024.12.16 11:34:57.186875 [ 4187 ] {965f1bfa-6d6c-4ebd-a91d-06c6f376d15c} executeQuery: Code: 60. DB::Exception: Table test_11.catalog_sales does not exist: While processing WITH cs_ui AS (SELECT cs_item_sk, sum(cs_ext_list_price) AS sale, sum((cr_refunded_cash + cr_reversed_charge) + cr_store_credit) AS refund FROM catalog_sales, catalog_returns WHERE (cs_item_sk = cr_item_sk) AND (cs_order_number = cr_order_number) GROUP BY cs_item_sk HAVING sum(cs_ext_list_price) > (2 * sum((cr_refunded_cash + cr_reversed_charge) + cr_store_credit))), cross_sales AS (SELECT i_product_name AS product_name, i_item_sk AS item_sk, s_store_name AS store_name, s_zip AS store_zip, ad1.ca_street_number AS b_street_number, ad1.ca_street_name AS b_street_name, ad1.ca_city AS b_city, ad1.ca_zip AS b_zip, ad2.ca_street_number AS c_street_number, ad2.ca_street_name AS c_street_name, ad2.ca_city AS c_city, ad2.ca_zip AS c_zip, d1.d_year AS syear, d2.d_year AS fsyear, d3.d_year AS s2year, count(*) AS cnt, sum(ss_wholesale_cost) AS s1, sum(ss_list_price) AS s2, sum(ss_coupon_amt) AS s3 FROM store_sales, store_returns, cs_ui, date_dim AS d1, date_dim AS d2, date_dim AS d3, store, customer, customer_demographics AS cd1, customer_demographics AS cd2, promotion, household_demographics AS hd1, household_demographics AS hd2, customer_address AS ad1, customer_address AS ad2, income_band AS ib1, income_band AS ib2, item WHERE (ss_store_sk = s_store_sk) AND (ss_sold_date_sk = d1.d_date_sk) AND (ss_customer_sk = c_customer_sk) AND (ss_cdemo_sk = cd1.cd_demo_sk) AND (ss_hdemo_sk = hd1.hd_demo_sk) AND (ss_addr_sk = ad1.ca_address_sk) AND (ss_item_sk = i_item_sk) AND (ss_item_sk = sr_item_sk) AND (ss_ticket_number = sr_ticket_number) AND (ss_item_sk = cs_ui.cs_item_sk) AND (c_current_cdemo_sk = cd2.cd_demo_sk) AND (c_current_hdemo_sk = hd2.hd_demo_sk) AND (c_current_addr_sk = ad2.ca_address_sk) AND (c_first_sales_date_sk = d2.d_date_sk) AND (c_first_shipto_date_sk = d3.d_date_sk) AND (ss_promo_sk = p_promo_sk) AND (hd1.hd_income_band_sk = ib1.ib_income_band_sk) AND (hd2.hd_income_band_sk = ib2.ib_income_band_sk) AND (cd1.cd_marital_status != cd2.cd_marital_status) AND (i_color IN ('maroon', 'burnished', 'dim', 'steel', 'navajo', 'chocolate')) AND ((i_current_price >= 35) AND (i_current_price <= (35 + 10))) AND ((i_current_price >= (35 + 1)) AND (i_current_price <= (35 + 15))) GROUP BY i_product_name, i_item_sk, s_store_name, s_zip, ad1.ca_street_number, ad1.ca_street_name, ad1.ca_city, ad1.ca_zip, ad2.ca_street_number, ad2.ca_street_name, ad2.ca_city, ad2.ca_zip, d1.d_year, d2.d_year, d3.d_year) SELECT cs1.product_name, cs1.store_name, cs1.store_zip, cs1.b_street_number, cs1.b_street_name, cs1.b_city, cs1.b_zip, cs1.c_street_number, cs1.c_street_name, cs1.c_city, cs1.c_zip, cs1.syear, cs1.cnt, cs1.s1 AS s11, cs1.s2 AS s21, cs1.s3 AS s31, cs2.s1 AS s12, cs2.s2 AS s22, cs2.s3 AS s32, cs2.syear, cs2.cnt FROM cross_sales AS cs1 ALL INNER JOIN cross_sales AS cs2 ON (cs1.item_sk = cs2.item_sk) AND (cs1.store_name = cs2.store_name) AND (cs1.store_zip = cs2.store_zip) WHERE (cs1.item_sk = cs2.item_sk) AND (cs1.syear = 2000) AND (cs2.syear = (2000 + 1)) AND (cs2.cnt <= cs1.cnt) AND (cs1.store_name = cs2.store_name) AND (cs1.store_zip = cs2.store_zip) ORDER BY cs1.product_name ASC, cs1.store_name ASC, cs2.cnt ASC, cs1.s1 ASC, cs2.s1 ASC. (UNKNOWN_TABLE) (version 24.3.12.76.altinitystable) (from [::1]:49792) (comment: 02421_exponential_join_rewrite_21557.sql) (in query: EXPLAIN SYNTAX WITH cs_ui AS ( SELECT cs_item_sk, sum(cs_ext_list_price) AS sale, sum((cr_refunded_cash + cr_reversed_charge) + cr_store_credit) AS refund FROM catalog_sales , catalog_returns WHERE (cs_item_sk = cr_item_sk) AND (cs_order_number = cr_order_number) GROUP BY cs_item_sk HAVING sum(cs_ext_list_price) > (2 * sum((cr_refunded_cash + cr_reversed_charge) + cr_store_credit)) ), cross_sales AS ( SELECT i_product_name AS product_name, i_item_sk AS item_sk, s_store_name AS store_name, s_zip AS store_zip, ad1.ca_street_number AS b_street_number, ad1.ca_street_name AS b_street_name, ad1.ca_city AS b_city, ad1.ca_zip AS b_zip, ad2.ca_street_number AS c_street_number, ad2.ca_street_name AS c_street_name, ad2.ca_city AS c_city, ad2.ca_zip AS c_zip, d1.d_year AS syear, d2.d_year AS fsyear, d3.d_year AS s2year, count(*) AS cnt, sum(ss_wholesale_cost) AS s1, sum(ss_list_price) AS s2, sum(ss_coupon_amt) AS s3 FROM store_sales , store_returns , cs_ui , date_dim AS d1 , date_dim AS d2 , date_dim AS d3 , store , customer , customer_demographics AS cd1 , customer_demographics AS cd2 , promotion , household_demographics AS hd1 , household_demographics AS hd2 , customer_address AS ad1 , customer_address AS ad2 , income_band AS ib1 , income_band AS ib2 , item WHERE (ss_store_sk = s_store_sk) AND (ss_sold_date_sk = d1.d_date_sk) AND (ss_customer_sk = c_customer_sk) AND (ss_cdemo_sk = cd1.cd_demo_sk) AND (ss_hdemo_sk = hd1.hd_demo_sk) AND (ss_addr_sk = ad1.ca_address_sk) AND (ss_item_sk = i_item_sk) AND (ss_item_sk = sr_item_sk) AND (ss_ticket_number = sr_ticket_number) AND (ss_item_sk = cs_ui.cs_item_sk) AND (c_current_cdemo_sk = cd2.cd_demo_sk) AND (c_current_hdemo_sk = hd2.hd_demo_sk) AND (c_current_addr_sk = ad2.ca_address_sk) AND (c_first_sales_date_sk = d2.d_date_sk) AND (c_first_shipto_date_sk = d3.d_date_sk) AND (ss_promo_sk = p_promo_sk) AND (hd1.hd_income_band_sk = ib1.ib_income_band_sk) AND (hd2.hd_income_band_sk = ib2.ib_income_band_sk) AND (cd1.cd_marital_status != cd2.cd_marital_status) AND (i_color IN ('maroon', 'burnished', 'dim', 'steel', 'navajo', 'chocolate')) AND ((i_current_price >= 35) AND (i_current_price <= (35 + 10))) AND ((i_current_price >= (35 + 1)) AND (i_current_price <= (35 + 15))) GROUP BY i_product_name, i_item_sk, s_store_name, s_zip, ad1.ca_street_number, ad1.ca_street_name, ad1.ca_city, ad1.ca_zip, ad2.ca_street_number, ad2.ca_street_name, ad2.ca_city, ad2.ca_zip, d1.d_year, d2.d_year, d3.d_year ) SELECT cs1.product_name, cs1.store_name, cs1.store_zip, cs1.b_street_number, cs1.b_street_name, cs1.b_city, cs1.b_zip, cs1.c_street_number, cs1.c_street_name, cs1.c_city, cs1.c_zip, cs1.syear, cs1.cnt, cs1.s1 AS s11, cs1.s2 AS s21, cs1.s3 AS s31, cs2.s1 AS s12, cs2.s2 AS s22, cs2.s3 AS s32, cs2.syear, cs2.cnt FROM cross_sales AS cs1 , cross_sales AS cs2 WHERE (cs1.item_sk = cs2.item_sk) AND (cs1.syear = 2000) AND (cs2.syear = (2000 + 1)) AND (cs2.cnt <= cs1.cnt) AND (cs1.store_name = cs2.store_name) AND (cs1.store_zip = cs2.store_zip) ORDER BY cs1.product_name ASC, cs1.store_name ASC, cs2.cnt ASC, cs1.s1 ASC, cs2.s1 ASC FORMAT Null ;), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000a8f27cc 6. /build/src/Databases/IDatabase.cpp:37: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000001a145b72 7. /build/src/Interpreters/DatabaseCatalog.cpp:429: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000001a66ff96 8. /build/src/Interpreters/DatabaseCatalog.cpp:952: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000001a6752e3 9. /build/src/Interpreters/JoinedTables.cpp:236: DB::JoinedTables::getLeftTableStorage() @ 0x000000001b6163f6 10. /build/src/Interpreters/InterpreterSelectQuery.cpp:459: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001b440ff4 11. /build/src/Interpreters/InterpreterSelectQuery.cpp:210: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x000000001b440486 12. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr&, DB::SelectQueryOptions&, std::vector> const&>(std::shared_ptr const&, std::shared_ptr&, DB::SelectQueryOptions&, std::vector> const&) @ 0x000000001b5e7861 13. /build/src/Interpreters/InterpreterSelectWithUnionQuery.cpp:255: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x000000001b5e4bc9 14. /build/src/Interpreters/InterpreterSelectWithUnionQuery.cpp:153: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x000000001b5e4045 15. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::InterpreterSelectWithUnionQuery* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions&, std::vector> const&, DB::InterpreterSelectWithUnionQuery*>(DB::InterpreterSelectWithUnionQuery*, std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions&, std::vector> const&) @ 0x000000001bbd6dd6 16. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions&, std::vector> const&, void, void>(std::allocator&, DB::InterpreterSelectWithUnionQuery*, std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions&, std::vector> const&) @ 0x000000001bbd6b79 17. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions&, std::vector> const&>(std::allocator, std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions&, std::vector> const&) @ 0x000000001bbd685f 18. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions&, std::vector> const&, void>(std::allocator const&, std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions&, std::vector> const&) @ 0x000000001bbd66d2 19. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions&, std::vector> const&, void>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions&, std::vector> const&) @ 0x000000001bbd665e 20. /build/src/Interpreters/interpretSubquery.cpp:116: DB::interpretSubquery(std::shared_ptr const&, std::shared_ptr, std::vector> const&, DB::SelectQueryOptions const&) @ 0x000000001bbd6491 21. /build/src/Interpreters/interpretSubquery.cpp:45: DB::interpretSubquery(std::shared_ptr const&, std::shared_ptr, std::vector> const&, DB::SelectQueryOptions const&) @ 0x000000001bbd587f 22. /build/src/Interpreters/ExpressionAnalyzer.cpp:1049: DB::buildJoinedPlan(std::shared_ptr, DB::ASTTablesInSelectQueryElement const&, DB::TableJoin&, DB::SelectQueryOptions) @ 0x000000001a6d0807 23. /build/src/Interpreters/ExpressionAnalyzer.cpp:1154: DB::SelectQueryExpressionAnalyzer::makeJoin(DB::ASTTablesInSelectQueryElement const&, std::vector> const&, std::shared_ptr&) @ 0x000000001a6ce055 24. /build/src/Interpreters/ExpressionAnalyzer.cpp:929: DB::SelectQueryExpressionAnalyzer::appendJoin(DB::ExpressionActionsChain&, std::shared_ptr&) @ 0x000000001a6cd57c 25. /build/src/Interpreters/ExpressionAnalyzer.cpp:1945: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000001a6d7ed2 26. /build/src/Interpreters/InterpreterSelectQuery.cpp:1059: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000001b454884 27. /build/src/Interpreters/InterpreterSelectQuery.cpp:799: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000001b44a13e 28. /build/src/Interpreters/InterpreterSelectQuery.cpp:809: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001b445242 29. /build/src/Interpreters/InterpreterSelectQuery.cpp:210: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x000000001b440486 30. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr&, DB::SelectQueryOptions&, std::vector> const&>(std::shared_ptr const&, std::shared_ptr&, DB::SelectQueryOptions&, std::vector> const&) @ 0x000000001b5e7861 31. /build/src/Interpreters/InterpreterSelectWithUnionQuery.cpp:255: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x000000001b5e4bc9 2024.12.16 11:34:57.206799 [ 4187 ] {965f1bfa-6d6c-4ebd-a91d-06c6f376d15c} TCPHandler: Code: 60. DB::Exception: Table test_11.catalog_sales does not exist: While processing WITH cs_ui AS (SELECT cs_item_sk, sum(cs_ext_list_price) AS sale, sum((cr_refunded_cash + cr_reversed_charge) + cr_store_credit) AS refund FROM catalog_sales, catalog_returns WHERE (cs_item_sk = cr_item_sk) AND (cs_order_number = cr_order_number) GROUP BY cs_item_sk HAVING sum(cs_ext_list_price) > (2 * sum((cr_refunded_cash + cr_reversed_charge) + cr_store_credit))), cross_sales AS (SELECT i_product_name AS product_name, i_item_sk AS item_sk, s_store_name AS store_name, s_zip AS store_zip, ad1.ca_street_number AS b_street_number, ad1.ca_street_name AS b_street_name, ad1.ca_city AS b_city, ad1.ca_zip AS b_zip, ad2.ca_street_number AS c_street_number, ad2.ca_street_name AS c_street_name, ad2.ca_city AS c_city, ad2.ca_zip AS c_zip, d1.d_year AS syear, d2.d_year AS fsyear, d3.d_year AS s2year, count(*) AS cnt, sum(ss_wholesale_cost) AS s1, sum(ss_list_price) AS s2, sum(ss_coupon_amt) AS s3 FROM store_sales, store_returns, cs_ui, date_dim AS d1, date_dim AS d2, date_dim AS d3, store, customer, customer_demographics AS cd1, customer_demographics AS cd2, promotion, household_demographics AS hd1, household_demographics AS hd2, customer_address AS ad1, customer_address AS ad2, income_band AS ib1, income_band AS ib2, item WHERE (ss_store_sk = s_store_sk) AND (ss_sold_date_sk = d1.d_date_sk) AND (ss_customer_sk = c_customer_sk) AND (ss_cdemo_sk = cd1.cd_demo_sk) AND (ss_hdemo_sk = hd1.hd_demo_sk) AND (ss_addr_sk = ad1.ca_address_sk) AND (ss_item_sk = i_item_sk) AND (ss_item_sk = sr_item_sk) AND (ss_ticket_number = sr_ticket_number) AND (ss_item_sk = cs_ui.cs_item_sk) AND (c_current_cdemo_sk = cd2.cd_demo_sk) AND (c_current_hdemo_sk = hd2.hd_demo_sk) AND (c_current_addr_sk = ad2.ca_address_sk) AND (c_first_sales_date_sk = d2.d_date_sk) AND (c_first_shipto_date_sk = d3.d_date_sk) AND (ss_promo_sk = p_promo_sk) AND (hd1.hd_income_band_sk = ib1.ib_income_band_sk) AND (hd2.hd_income_band_sk = ib2.ib_income_band_sk) AND (cd1.cd_marital_status != cd2.cd_marital_status) AND (i_color IN ('maroon', 'burnished', 'dim', 'steel', 'navajo', 'chocolate')) AND ((i_current_price >= 35) AND (i_current_price <= (35 + 10))) AND ((i_current_price >= (35 + 1)) AND (i_current_price <= (35 + 15))) GROUP BY i_product_name, i_item_sk, s_store_name, s_zip, ad1.ca_street_number, ad1.ca_street_name, ad1.ca_city, ad1.ca_zip, ad2.ca_street_number, ad2.ca_street_name, ad2.ca_city, ad2.ca_zip, d1.d_year, d2.d_year, d3.d_year) SELECT cs1.product_name, cs1.store_name, cs1.store_zip, cs1.b_street_number, cs1.b_street_name, cs1.b_city, cs1.b_zip, cs1.c_street_number, cs1.c_street_name, cs1.c_city, cs1.c_zip, cs1.syear, cs1.cnt, cs1.s1 AS s11, cs1.s2 AS s21, cs1.s3 AS s31, cs2.s1 AS s12, cs2.s2 AS s22, cs2.s3 AS s32, cs2.syear, cs2.cnt FROM cross_sales AS cs1 ALL INNER JOIN cross_sales AS cs2 ON (cs1.item_sk = cs2.item_sk) AND (cs1.store_name = cs2.store_name) AND (cs1.store_zip = cs2.store_zip) WHERE (cs1.item_sk = cs2.item_sk) AND (cs1.syear = 2000) AND (cs2.syear = (2000 + 1)) AND (cs2.cnt <= cs1.cnt) AND (cs1.store_name = cs2.store_name) AND (cs1.store_zip = cs2.store_zip) ORDER BY cs1.product_name ASC, cs1.store_name ASC, cs2.cnt ASC, cs1.s1 ASC, cs2.s1 ASC. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000000a8f27cc 6. /build/src/Databases/IDatabase.cpp:37: DB::IDatabase::getTable(String const&, std::shared_ptr) const @ 0x000000001a145b72 7. /build/src/Interpreters/DatabaseCatalog.cpp:429: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr, std::optional*) const @ 0x000000001a66ff96 8. /build/src/Interpreters/DatabaseCatalog.cpp:952: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr) const @ 0x000000001a6752e3 9. /build/src/Interpreters/JoinedTables.cpp:236: DB::JoinedTables::getLeftTableStorage() @ 0x000000001b6163f6 10. /build/src/Interpreters/InterpreterSelectQuery.cpp:459: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001b440ff4 11. /build/src/Interpreters/InterpreterSelectQuery.cpp:210: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x000000001b440486 12. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr&, DB::SelectQueryOptions&, std::vector> const&>(std::shared_ptr const&, std::shared_ptr&, DB::SelectQueryOptions&, std::vector> const&) @ 0x000000001b5e7861 13. /build/src/Interpreters/InterpreterSelectWithUnionQuery.cpp:255: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x000000001b5e4bc9 14. /build/src/Interpreters/InterpreterSelectWithUnionQuery.cpp:153: DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x000000001b5e4045 15. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::InterpreterSelectWithUnionQuery* std::construct_at[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions&, std::vector> const&, DB::InterpreterSelectWithUnionQuery*>(DB::InterpreterSelectWithUnionQuery*, std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions&, std::vector> const&) @ 0x000000001bbd6dd6 16. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions&, std::vector> const&, void, void>(std::allocator&, DB::InterpreterSelectWithUnionQuery*, std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions&, std::vector> const&) @ 0x000000001bbd6b79 17. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions&, std::vector> const&>(std::allocator, std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions&, std::vector> const&) @ 0x000000001bbd685f 18. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions&, std::vector> const&, void>(std::allocator const&, std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions&, std::vector> const&) @ 0x000000001bbd66d2 19. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000]&, std::shared_ptr&, DB::SelectQueryOptions&, std::vector> const&, void>(std::shared_ptr&, std::shared_ptr&, DB::SelectQueryOptions&, std::vector> const&) @ 0x000000001bbd665e 20. /build/src/Interpreters/interpretSubquery.cpp:116: DB::interpretSubquery(std::shared_ptr const&, std::shared_ptr, std::vector> const&, DB::SelectQueryOptions const&) @ 0x000000001bbd6491 21. /build/src/Interpreters/interpretSubquery.cpp:45: DB::interpretSubquery(std::shared_ptr const&, std::shared_ptr, std::vector> const&, DB::SelectQueryOptions const&) @ 0x000000001bbd587f 22. /build/src/Interpreters/ExpressionAnalyzer.cpp:1049: DB::buildJoinedPlan(std::shared_ptr, DB::ASTTablesInSelectQueryElement const&, DB::TableJoin&, DB::SelectQueryOptions) @ 0x000000001a6d0807 23. /build/src/Interpreters/ExpressionAnalyzer.cpp:1154: DB::SelectQueryExpressionAnalyzer::makeJoin(DB::ASTTablesInSelectQueryElement const&, std::vector> const&, std::shared_ptr&) @ 0x000000001a6ce055 24. /build/src/Interpreters/ExpressionAnalyzer.cpp:929: DB::SelectQueryExpressionAnalyzer::appendJoin(DB::ExpressionActionsChain&, std::shared_ptr&) @ 0x000000001a6cd57c 25. /build/src/Interpreters/ExpressionAnalyzer.cpp:1945: DB::ExpressionAnalysisResult::ExpressionAnalysisResult(DB::SelectQueryExpressionAnalyzer&, std::shared_ptr const&, bool, bool, bool, std::shared_ptr const&, std::shared_ptr const&, DB::Block const&) @ 0x000000001a6d7ed2 26. /build/src/Interpreters/InterpreterSelectQuery.cpp:1059: DB::InterpreterSelectQuery::getSampleBlockImpl() @ 0x000000001b454884 27. /build/src/Interpreters/InterpreterSelectQuery.cpp:799: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr)::$_0::operator()(bool) const @ 0x000000001b44a13e 28. /build/src/Interpreters/InterpreterSelectQuery.cpp:809: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001b445242 29. /build/src/Interpreters/InterpreterSelectQuery.cpp:210: DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x000000001b440486 30. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15000] const&, std::shared_ptr&, DB::SelectQueryOptions&, std::vector> const&>(std::shared_ptr const&, std::shared_ptr&, DB::SelectQueryOptions&, std::vector> const&) @ 0x000000001b5e7861 31. /build/src/Interpreters/InterpreterSelectWithUnionQuery.cpp:255: DB::InterpreterSelectWithUnionQuery::buildCurrentChildInterpreter(std::shared_ptr const&, std::vector> const&) @ 0x000000001b5e4bc9 2024.12.16 11:34:57.207649 [ 4187 ] {965f1bfa-6d6c-4ebd-a91d-06c6f376d15c} TCPHandler: Client has gone away. 2024.12.16 11:35:02.256422 [ 8528 ] {} BaseDaemon: This ClickHouse version is not official and should be upgraded to the official build. 2024.12.16 11:35:02.257457 [ 8528 ] {} BaseDaemon: Changed settings: min_compress_block_size = 1974342, max_compress_block_size = 2246931, max_block_size = 95311, max_insert_threads = 8, max_threads = 6, max_read_buffer_size = 771110, connect_timeout_with_failover_ms = 2000, connect_timeout_with_failover_secure_ms = 3000, idle_connection_timeout = 36000, s3_check_objects_after_upload = true, use_uncompressed_cache = true, stream_like_engine_allow_direct_select = true, replication_wait_for_inactive_replica_timeout = 30, min_count_to_compile_expression = 0, compile_aggregate_expressions = false, min_count_to_compile_sort_description = 0, group_by_two_level_threshold = 1, group_by_two_level_threshold_bytes = 32503462, enable_memory_bound_merging_of_aggregation_results = false, allow_nonconst_timezone_arguments = true, max_parallel_replicas = 2, allow_experimental_parallel_reading_from_replicas = 0, input_format_parallel_parsing = false, min_chunk_bytes_for_parallel_parsing = 4267066, output_format_parallel_formatting = false, merge_tree_coarse_index_granularity = 18, min_bytes_to_use_direct_io = 10737418240, min_bytes_to_use_mmap_io = 10737418240, log_queries = true, insert_quorum_timeout = 60000, merge_tree_read_split_ranges_into_intersecting_and_non_intersecting_injection_probability = 0.18000000715255737, http_wait_end_of_query = true, http_response_buffer_size = 5716554, fsync_metadata = true, http_send_timeout = 60., http_receive_timeout = 60., http_make_head_request = false, opentelemetry_start_trace_probability = 0.10000000149011612, max_bytes_before_external_group_by = 1, max_bytes_before_external_sort = 10737418240, max_bytes_before_remerge_sort = 1300478267, max_memory_usage = 10000000000, max_memory_usage_for_user = 9856953139, max_untracked_memory = 1048576, memory_profiler_step = 1048576, log_comment = '00124_shard_distributed_with_many_replicas.sql', send_logs_level = 'warning', optimize_aggregation_in_order = true, aggregation_in_order_max_block_bytes = 11655246, read_in_order_two_level_merge_threshold = 54, allow_introspection_functions = true, database_atomic_wait_for_drop_and_detach_synchronously = true, optimize_or_like_chain = true, optimize_if_chain_to_multiif = true, optimize_if_transform_strings_to_enum = true, optimize_substitute_columns = true, distributed_ddl_entry_format_version = 6, local_filesystem_read_method = 'read', remote_filesystem_read_method = 'read', merge_tree_compact_parts_min_granules_to_multibuffer_read = 56, async_insert_busy_timeout_max_ms = 5000, enable_filesystem_cache = true, enable_filesystem_cache_on_write_operations = true, read_from_filesystem_cache_if_exists_otherwise_bypass_cache = true, filesystem_cache_segments_batch_size = 10, use_page_cache_for_disks_without_file_cache = true, page_cache_inject_eviction = true, load_marks_asynchronously = true, allow_prefetched_read_pool_for_remote_filesystem = false, allow_prefetched_read_pool_for_local_filesystem = false, filesystem_prefetch_min_bytes_for_single_read_task = 16777216, filesystem_prefetch_max_memory_usage = 67108864, filesystem_prefetches_limit = 0, allow_deprecated_database_ordinary = true, allow_deprecated_syntax_for_merge_tree = true, optimize_sorting_by_input_stream_properties = false, insert_keeper_max_retries = 100, insert_keeper_retry_initial_backoff_ms = 1, insert_keeper_retry_max_backoff_ms = 1, insert_keeper_fault_injection_probability = 0.009999999776482582, throw_on_unsupported_query_inside_transaction = false, implicit_transaction = true, session_timezone = 'America/Hermosillo', prefer_warmed_unmerged_parts_seconds = 8 2024.12.16 11:35:06.361384 [ 2751 ] {} Application: Child process was terminated by signal 6. 2024.12.16 12:06:43.118841 [ 8689 ] {} Context: Server was built in debug mode. It will work slowly. 2024.12.16 12:06:43.149758 [ 8689 ] {} Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production. 2024.12.16 12:06:43.151143 [ 8689 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2024.12.16 12:06:43.153868 [ 8689 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2024.12.16 12:06:43.154027 [ 8689 ] {} Application: Integrity check of the executable skipped because the reference checksum could not be read. 2024.12.16 12:06:45.559889 [ 8689 ] {} CloudPlacementInfo: Placement info has not been loaded 2024.12.16 12:06:45.989502 [ 8689 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2024.12.16 12:06:45.995183 [ 8689 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2024.12.16 12:06:45.995276 [ 8689 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2024.12.16 12:06:46.046981 [ 9335 ] {} RaftInstance: Election timeout, initiate leader election 2024.12.16 12:06:49.767942 [ 9460 ] {} system.metric_log (47ae6795-c9da-47dc-9e1f-695199e4ce0e): Removing temporary directory /var/lib/clickhouse/disks/s3/store/47a/47ae6795-c9da-47dc-9e1f-695199e4ce0e/tmp_merge_202412_1_20_4/ 2024.12.16 12:06:49.768087 [ 9460 ] {} system.metric_log (47ae6795-c9da-47dc-9e1f-695199e4ce0e): Since zero-copy replication is enabled we are not going to remove blobs from shared storage for /var/lib/clickhouse/disks/s3/store/47a/47ae6795-c9da-47dc-9e1f-695199e4ce0e/tmp_merge_202412_1_20_4/ 2024.12.16 12:06:50.255949 [ 8689 ] {} Context: Table system.session_log is enabled. It's unreliable and may contain garbage. Do not use it for any kind of security monitoring. 2024.12.16 12:06:50.881516 [ 8689 ] {} Context: Server has databases (for example `test_ip6kl7xs_3`) with Ordinary engine, which was deprecated. To convert this database to the new Atomic engine, create a flag /var/lib/clickhouse/flags/convert_ordinary_to_atomic and make sure that ClickHouse has write permission for it. Example: sudo touch '/var/lib/clickhouse/flags/convert_ordinary_to_atomic' && sudo chmod 666 '/var/lib/clickhouse/flags/convert_ordinary_to_atomic' 2024.12.16 12:06:51.415254 [ 9435 ] {} void DB::AsyncLoader::worker(Pool &): Code: 1. DB::Exception: Experimental WINDOW VIEW feature is not supported with new infrastructure for query analysis (the setting 'allow_experimental_analyzer'): Cannot attach table `test_1`.`wv` from metadata file /var/lib/clickhouse/store/a78/a7828c9b-5200-481c-ac66-4570598f91a1/wv.sql from query ATTACH WINDOW VIEW test_1.wv UUID 'a2de7aa9-7124-4016-995e-d12992706b6f' TO test_1.dst (`count` UInt64, `market` Int32, `w_end` DateTime('US/Samoa')) WATERMARK ASCENDING AS SELECT count(a) AS count, market, tumbleEnd(wid) AS w_end FROM test_1.mt GROUP BY tumble(timestamp, toIntervalSecond('5'), 'US/Samoa') AS wid, market. (UNSUPPORTED_METHOD), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f4eb7 6. /build/src/Storages/WindowView/StorageWindowView.cpp:1181: DB::StorageWindowView::StorageWindowView(DB::StorageID const&, std::shared_ptr, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel) @ 0x000000001d170c0d 7. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageWindowView* std::construct_at[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, DB::StorageWindowView*>(DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a5e3 8. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void, void>(std::allocator&, DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a361 9. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&>(std::allocator, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a02d 10. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, std::shared_ptr, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(std::allocator const&, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189e7a 11. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189e06 12. /build/src/Storages/WindowView/StorageWindowView.cpp:1693: DB::registerStorageWindowView(DB::StorageFactory&)::$_0::operator()(DB::StorageFactory::Arguments const&) const @ 0x000000001d17d7a6 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d17d61d 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001d17d5bd 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d17d57d 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d17d545 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001c3709de 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001c36f2fd 19. /build/src/Storages/StorageFactory.cpp:224: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, DB::LoadingStrictnessLevel) const @ 0x000000001c36dc1d 20. /build/src/Databases/DatabaseOnDisk.cpp:120: DB::createTableFromAST(DB::ASTCreateQuery, String const&, String const&, std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000001a0b0752 21. /build/src/Databases/DatabaseOrdinary.cpp:248: DB::DatabaseOrdinary::loadTableFromMetadata(std::shared_ptr, String const&, DB::QualifiedTableName const&, std::shared_ptr const&, DB::LoadingStrictnessLevel) @ 0x000000001a0d947b 22. /build/src/Databases/DatabaseOrdinary.cpp:283: DB::DatabaseOrdinary::loadTableFromMetadataAsync(DB::AsyncLoader&, std::unordered_set, std::hash>, std::equal_to>, std::allocator>>, std::shared_ptr, String const&, DB::QualifiedTableName const&, std::shared_ptr const&, DB::LoadingStrictnessLevel)::$_0::operator()(DB::AsyncLoader&, std::shared_ptr const&) const @ 0x000000001a0e0c63 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a0e0be5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a0e0ba5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a0e0b65 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a0e0b30 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000135ff446 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000135f5ac5 29. /build/src/Common/AsyncLoader.cpp:169: DB::LoadJob::execute(DB::AsyncLoader&, unsigned long, std::shared_ptr const&) @ 0x00000000135e790b 30. /build/src/Common/AsyncLoader.cpp:937: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f3f67 31. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock&)::$_1::operator()() const @ 0x00000000135f52dc (version 24.3.12.76.altinitystable) 2024.12.16 12:06:51.477280 [ 8689 ] {} Application: Caught exception while loading metadata: Code: 695. DB::Exception: Load job 'load table test_1.wv' failed: Code: 1. DB::Exception: Experimental WINDOW VIEW feature is not supported with new infrastructure for query analysis (the setting 'allow_experimental_analyzer'): Cannot attach table `test_1`.`wv` from metadata file /var/lib/clickhouse/store/a78/a7828c9b-5200-481c-ac66-4570598f91a1/wv.sql from query ATTACH WINDOW VIEW test_1.wv UUID 'a2de7aa9-7124-4016-995e-d12992706b6f' TO test_1.dst (`count` UInt64, `market` Int32, `w_end` DateTime('US/Samoa')) WATERMARK ASCENDING AS SELECT count(a) AS count, market, tumbleEnd(wid) AS w_end FROM test_1.mt GROUP BY tumble(timestamp, toIntervalSecond('5'), 'US/Samoa') AS wid, market. (UNSUPPORTED_METHOD), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f4eb7 6. /build/src/Storages/WindowView/StorageWindowView.cpp:1181: DB::StorageWindowView::StorageWindowView(DB::StorageID const&, std::shared_ptr, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel) @ 0x000000001d170c0d 7. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageWindowView* std::construct_at[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, DB::StorageWindowView*>(DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a5e3 8. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void, void>(std::allocator&, DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a361 9. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&>(std::allocator, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a02d 10. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, std::shared_ptr, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(std::allocator const&, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189e7a 11. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189e06 12. /build/src/Storages/WindowView/StorageWindowView.cpp:1693: DB::registerStorageWindowView(DB::StorageFactory&)::$_0::operator()(DB::StorageFactory::Arguments const&) const @ 0x000000001d17d7a6 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d17d61d 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001d17d5bd 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d17d57d 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d17d545 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001c3709de 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001c36f2fd 19. /build/src/Storages/StorageFactory.cpp:224: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, DB::LoadingStrictnessLevel) const @ 0x000000001c36dc1d 20. /build/src/Databases/DatabaseOnDisk.cpp:120: DB::createTableFromAST(DB::ASTCreateQuery, String const&, String const&, std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000001a0b0752 21. /build/src/Databases/DatabaseOrdinary.cpp:248: DB::DatabaseOrdinary::loadTableFromMetadata(std::shared_ptr, String const&, DB::QualifiedTableName const&, std::shared_ptr const&, DB::LoadingStrictnessLevel) @ 0x000000001a0d947b 22. /build/src/Databases/DatabaseOrdinary.cpp:283: DB::DatabaseOrdinary::loadTableFromMetadataAsync(DB::AsyncLoader&, std::unordered_set, std::hash>, std::equal_to>, std::allocator>>, std::shared_ptr, String const&, DB::QualifiedTableName const&, std::shared_ptr const&, DB::LoadingStrictnessLevel)::$_0::operator()(DB::AsyncLoader&, std::shared_ptr const&) const @ 0x000000001a0e0c63 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a0e0be5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a0e0ba5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a0e0b65 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a0e0b30 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000135ff446 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000135f5ac5 29. /build/src/Common/AsyncLoader.cpp:169: DB::LoadJob::execute(DB::AsyncLoader&, unsigned long, std::shared_ptr const&) @ 0x00000000135e790b 30. /build/src/Common/AsyncLoader.cpp:937: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f3f67 31. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock&)::$_1::operator()() const @ 0x00000000135f52dc (version 24.3.12.76.altinitystable). (ASYNC_LOAD_FAILED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String const&, String&&) @ 0x000000000b4fe4cc 6. /build/src/Common/AsyncLoader.cpp:942: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f415d 7. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock&)::$_1::operator()() const @ 0x00000000135f52dc 8. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000135f52b5 9. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000135f5295 10. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000135f5275 11. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000135f523d 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 14. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 15. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 17. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 18. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 19. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 20. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 26. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 27. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 29. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 30. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 31. ? @ 0x00007f619fcbeac3 (version 24.3.12.76.altinitystable) 2024.12.16 12:06:57.737678 [ 8689 ] {} Application: Code: 695. DB::Exception: Load job 'load table test_1.wv' failed: Code: 1. DB::Exception: Experimental WINDOW VIEW feature is not supported with new infrastructure for query analysis (the setting 'allow_experimental_analyzer'): Cannot attach table `test_1`.`wv` from metadata file /var/lib/clickhouse/store/a78/a7828c9b-5200-481c-ac66-4570598f91a1/wv.sql from query ATTACH WINDOW VIEW test_1.wv UUID 'a2de7aa9-7124-4016-995e-d12992706b6f' TO test_1.dst (`count` UInt64, `market` Int32, `w_end` DateTime('US/Samoa')) WATERMARK ASCENDING AS SELECT count(a) AS count, market, tumbleEnd(wid) AS w_end FROM test_1.mt GROUP BY tumble(timestamp, toIntervalSecond('5'), 'US/Samoa') AS wid, market. (UNSUPPORTED_METHOD), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f4eb7 6. /build/src/Storages/WindowView/StorageWindowView.cpp:1181: DB::StorageWindowView::StorageWindowView(DB::StorageID const&, std::shared_ptr, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel) @ 0x000000001d170c0d 7. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageWindowView* std::construct_at[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, DB::StorageWindowView*>(DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a5e3 8. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void, void>(std::allocator&, DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a361 9. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&>(std::allocator, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a02d 10. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, std::shared_ptr, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(std::allocator const&, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189e7a 11. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189e06 12. /build/src/Storages/WindowView/StorageWindowView.cpp:1693: DB::registerStorageWindowView(DB::StorageFactory&)::$_0::operator()(DB::StorageFactory::Arguments const&) const @ 0x000000001d17d7a6 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d17d61d 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001d17d5bd 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d17d57d 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d17d545 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001c3709de 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001c36f2fd 19. /build/src/Storages/StorageFactory.cpp:224: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, DB::LoadingStrictnessLevel) const @ 0x000000001c36dc1d 20. /build/src/Databases/DatabaseOnDisk.cpp:120: DB::createTableFromAST(DB::ASTCreateQuery, String const&, String const&, std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000001a0b0752 21. /build/src/Databases/DatabaseOrdinary.cpp:248: DB::DatabaseOrdinary::loadTableFromMetadata(std::shared_ptr, String const&, DB::QualifiedTableName const&, std::shared_ptr const&, DB::LoadingStrictnessLevel) @ 0x000000001a0d947b 22. /build/src/Databases/DatabaseOrdinary.cpp:283: DB::DatabaseOrdinary::loadTableFromMetadataAsync(DB::AsyncLoader&, std::unordered_set, std::hash>, std::equal_to>, std::allocator>>, std::shared_ptr, String const&, DB::QualifiedTableName const&, std::shared_ptr const&, DB::LoadingStrictnessLevel)::$_0::operator()(DB::AsyncLoader&, std::shared_ptr const&) const @ 0x000000001a0e0c63 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a0e0be5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a0e0ba5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a0e0b65 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a0e0b30 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000135ff446 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000135f5ac5 29. /build/src/Common/AsyncLoader.cpp:169: DB::LoadJob::execute(DB::AsyncLoader&, unsigned long, std::shared_ptr const&) @ 0x00000000135e790b 30. /build/src/Common/AsyncLoader.cpp:937: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f3f67 31. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock&)::$_1::operator()() const @ 0x00000000135f52dc (version 24.3.12.76.altinitystable). (ASYNC_LOAD_FAILED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String const&, String&&) @ 0x000000000b4fe4cc 6. /build/src/Common/AsyncLoader.cpp:942: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f415d 7. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock&)::$_1::operator()() const @ 0x00000000135f52dc 8. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000135f52b5 9. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000135f5295 10. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000135f5275 11. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000135f523d 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 14. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 15. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 17. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 18. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 19. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 20. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 26. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 27. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 29. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 30. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 31. ? @ 0x00007f619fcbeac3 (version 24.3.12.76.altinitystable) 2024.12.16 12:06:58.996552 [ 9544 ] {} Context: Server was built in debug mode. It will work slowly. 2024.12.16 12:06:59.027397 [ 9544 ] {} Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production. 2024.12.16 12:06:59.028999 [ 9544 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2024.12.16 12:06:59.032075 [ 9544 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2024.12.16 12:06:59.032275 [ 9544 ] {} Application: Integrity check of the executable skipped because the reference checksum could not be read. 2024.12.16 12:07:01.592058 [ 9544 ] {} CloudPlacementInfo: Placement info has not been loaded 2024.12.16 12:07:02.008527 [ 9544 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2024.12.16 12:07:02.015429 [ 9544 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2024.12.16 12:07:02.015557 [ 9544 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2024.12.16 12:07:02.067339 [ 10189 ] {} RaftInstance: Election timeout, initiate leader election 2024.12.16 12:07:04.605746 [ 9544 ] {} Context: Table system.session_log is enabled. It's unreliable and may contain garbage. Do not use it for any kind of security monitoring. 2024.12.16 12:07:05.132030 [ 9544 ] {} Context: Server has databases (for example `test_ip6kl7xs_3`) with Ordinary engine, which was deprecated. To convert this database to the new Atomic engine, create a flag /var/lib/clickhouse/flags/convert_ordinary_to_atomic and make sure that ClickHouse has write permission for it. Example: sudo touch '/var/lib/clickhouse/flags/convert_ordinary_to_atomic' && sudo chmod 666 '/var/lib/clickhouse/flags/convert_ordinary_to_atomic' 2024.12.16 12:07:05.610998 [ 10301 ] {} void DB::AsyncLoader::worker(Pool &): Code: 1. DB::Exception: Experimental WINDOW VIEW feature is not supported with new infrastructure for query analysis (the setting 'allow_experimental_analyzer'): Cannot attach table `test_1`.`wv` from metadata file /var/lib/clickhouse/store/a78/a7828c9b-5200-481c-ac66-4570598f91a1/wv.sql from query ATTACH WINDOW VIEW test_1.wv UUID 'a2de7aa9-7124-4016-995e-d12992706b6f' TO test_1.dst (`count` UInt64, `market` Int32, `w_end` DateTime('US/Samoa')) WATERMARK ASCENDING AS SELECT count(a) AS count, market, tumbleEnd(wid) AS w_end FROM test_1.mt GROUP BY tumble(timestamp, toIntervalSecond('5'), 'US/Samoa') AS wid, market. (UNSUPPORTED_METHOD), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f4eb7 6. /build/src/Storages/WindowView/StorageWindowView.cpp:1181: DB::StorageWindowView::StorageWindowView(DB::StorageID const&, std::shared_ptr, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel) @ 0x000000001d170c0d 7. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageWindowView* std::construct_at[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, DB::StorageWindowView*>(DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a5e3 8. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void, void>(std::allocator&, DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a361 9. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&>(std::allocator, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a02d 10. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, std::shared_ptr, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(std::allocator const&, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189e7a 11. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189e06 12. /build/src/Storages/WindowView/StorageWindowView.cpp:1693: DB::registerStorageWindowView(DB::StorageFactory&)::$_0::operator()(DB::StorageFactory::Arguments const&) const @ 0x000000001d17d7a6 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d17d61d 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001d17d5bd 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d17d57d 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d17d545 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001c3709de 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001c36f2fd 19. /build/src/Storages/StorageFactory.cpp:224: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, DB::LoadingStrictnessLevel) const @ 0x000000001c36dc1d 20. /build/src/Databases/DatabaseOnDisk.cpp:120: DB::createTableFromAST(DB::ASTCreateQuery, String const&, String const&, std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000001a0b0752 21. /build/src/Databases/DatabaseOrdinary.cpp:248: DB::DatabaseOrdinary::loadTableFromMetadata(std::shared_ptr, String const&, DB::QualifiedTableName const&, std::shared_ptr const&, DB::LoadingStrictnessLevel) @ 0x000000001a0d947b 22. /build/src/Databases/DatabaseOrdinary.cpp:283: DB::DatabaseOrdinary::loadTableFromMetadataAsync(DB::AsyncLoader&, std::unordered_set, std::hash>, std::equal_to>, std::allocator>>, std::shared_ptr, String const&, DB::QualifiedTableName const&, std::shared_ptr const&, DB::LoadingStrictnessLevel)::$_0::operator()(DB::AsyncLoader&, std::shared_ptr const&) const @ 0x000000001a0e0c63 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a0e0be5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a0e0ba5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a0e0b65 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a0e0b30 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000135ff446 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000135f5ac5 29. /build/src/Common/AsyncLoader.cpp:169: DB::LoadJob::execute(DB::AsyncLoader&, unsigned long, std::shared_ptr const&) @ 0x00000000135e790b 30. /build/src/Common/AsyncLoader.cpp:937: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f3f67 31. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock&)::$_1::operator()() const @ 0x00000000135f52dc (version 24.3.12.76.altinitystable) 2024.12.16 12:07:06.063278 [ 9544 ] {} Application: Caught exception while loading metadata: Code: 695. DB::Exception: Load job 'load table test_1.wv' failed: Code: 1. DB::Exception: Experimental WINDOW VIEW feature is not supported with new infrastructure for query analysis (the setting 'allow_experimental_analyzer'): Cannot attach table `test_1`.`wv` from metadata file /var/lib/clickhouse/store/a78/a7828c9b-5200-481c-ac66-4570598f91a1/wv.sql from query ATTACH WINDOW VIEW test_1.wv UUID 'a2de7aa9-7124-4016-995e-d12992706b6f' TO test_1.dst (`count` UInt64, `market` Int32, `w_end` DateTime('US/Samoa')) WATERMARK ASCENDING AS SELECT count(a) AS count, market, tumbleEnd(wid) AS w_end FROM test_1.mt GROUP BY tumble(timestamp, toIntervalSecond('5'), 'US/Samoa') AS wid, market. (UNSUPPORTED_METHOD), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f4eb7 6. /build/src/Storages/WindowView/StorageWindowView.cpp:1181: DB::StorageWindowView::StorageWindowView(DB::StorageID const&, std::shared_ptr, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel) @ 0x000000001d170c0d 7. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageWindowView* std::construct_at[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, DB::StorageWindowView*>(DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a5e3 8. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void, void>(std::allocator&, DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a361 9. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&>(std::allocator, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a02d 10. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, std::shared_ptr, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(std::allocator const&, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189e7a 11. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189e06 12. /build/src/Storages/WindowView/StorageWindowView.cpp:1693: DB::registerStorageWindowView(DB::StorageFactory&)::$_0::operator()(DB::StorageFactory::Arguments const&) const @ 0x000000001d17d7a6 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d17d61d 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001d17d5bd 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d17d57d 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d17d545 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001c3709de 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001c36f2fd 19. /build/src/Storages/StorageFactory.cpp:224: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, DB::LoadingStrictnessLevel) const @ 0x000000001c36dc1d 20. /build/src/Databases/DatabaseOnDisk.cpp:120: DB::createTableFromAST(DB::ASTCreateQuery, String const&, String const&, std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000001a0b0752 21. /build/src/Databases/DatabaseOrdinary.cpp:248: DB::DatabaseOrdinary::loadTableFromMetadata(std::shared_ptr, String const&, DB::QualifiedTableName const&, std::shared_ptr const&, DB::LoadingStrictnessLevel) @ 0x000000001a0d947b 22. /build/src/Databases/DatabaseOrdinary.cpp:283: DB::DatabaseOrdinary::loadTableFromMetadataAsync(DB::AsyncLoader&, std::unordered_set, std::hash>, std::equal_to>, std::allocator>>, std::shared_ptr, String const&, DB::QualifiedTableName const&, std::shared_ptr const&, DB::LoadingStrictnessLevel)::$_0::operator()(DB::AsyncLoader&, std::shared_ptr const&) const @ 0x000000001a0e0c63 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a0e0be5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a0e0ba5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a0e0b65 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a0e0b30 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000135ff446 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000135f5ac5 29. /build/src/Common/AsyncLoader.cpp:169: DB::LoadJob::execute(DB::AsyncLoader&, unsigned long, std::shared_ptr const&) @ 0x00000000135e790b 30. /build/src/Common/AsyncLoader.cpp:937: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f3f67 31. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock&)::$_1::operator()() const @ 0x00000000135f52dc (version 24.3.12.76.altinitystable). (ASYNC_LOAD_FAILED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String const&, String&&) @ 0x000000000b4fe4cc 6. /build/src/Common/AsyncLoader.cpp:942: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f415d 7. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock&)::$_1::operator()() const @ 0x00000000135f52dc 8. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000135f52b5 9. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000135f5295 10. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000135f5275 11. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000135f523d 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 14. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 15. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 17. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 18. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 19. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 20. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 26. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 27. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 29. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 30. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 31. ? @ 0x00007fd3ce7a5ac3 (version 24.3.12.76.altinitystable) 2024.12.16 12:07:10.589389 [ 9544 ] {} Application: Code: 695. DB::Exception: Load job 'load table test_1.wv' failed: Code: 1. DB::Exception: Experimental WINDOW VIEW feature is not supported with new infrastructure for query analysis (the setting 'allow_experimental_analyzer'): Cannot attach table `test_1`.`wv` from metadata file /var/lib/clickhouse/store/a78/a7828c9b-5200-481c-ac66-4570598f91a1/wv.sql from query ATTACH WINDOW VIEW test_1.wv UUID 'a2de7aa9-7124-4016-995e-d12992706b6f' TO test_1.dst (`count` UInt64, `market` Int32, `w_end` DateTime('US/Samoa')) WATERMARK ASCENDING AS SELECT count(a) AS count, market, tumbleEnd(wid) AS w_end FROM test_1.mt GROUP BY tumble(timestamp, toIntervalSecond('5'), 'US/Samoa') AS wid, market. (UNSUPPORTED_METHOD), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f4eb7 6. /build/src/Storages/WindowView/StorageWindowView.cpp:1181: DB::StorageWindowView::StorageWindowView(DB::StorageID const&, std::shared_ptr, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel) @ 0x000000001d170c0d 7. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageWindowView* std::construct_at[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, DB::StorageWindowView*>(DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a5e3 8. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void, void>(std::allocator&, DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a361 9. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&>(std::allocator, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a02d 10. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, std::shared_ptr, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(std::allocator const&, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189e7a 11. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189e06 12. /build/src/Storages/WindowView/StorageWindowView.cpp:1693: DB::registerStorageWindowView(DB::StorageFactory&)::$_0::operator()(DB::StorageFactory::Arguments const&) const @ 0x000000001d17d7a6 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d17d61d 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001d17d5bd 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d17d57d 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d17d545 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001c3709de 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001c36f2fd 19. /build/src/Storages/StorageFactory.cpp:224: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, DB::LoadingStrictnessLevel) const @ 0x000000001c36dc1d 20. /build/src/Databases/DatabaseOnDisk.cpp:120: DB::createTableFromAST(DB::ASTCreateQuery, String const&, String const&, std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000001a0b0752 21. /build/src/Databases/DatabaseOrdinary.cpp:248: DB::DatabaseOrdinary::loadTableFromMetadata(std::shared_ptr, String const&, DB::QualifiedTableName const&, std::shared_ptr const&, DB::LoadingStrictnessLevel) @ 0x000000001a0d947b 22. /build/src/Databases/DatabaseOrdinary.cpp:283: DB::DatabaseOrdinary::loadTableFromMetadataAsync(DB::AsyncLoader&, std::unordered_set, std::hash>, std::equal_to>, std::allocator>>, std::shared_ptr, String const&, DB::QualifiedTableName const&, std::shared_ptr const&, DB::LoadingStrictnessLevel)::$_0::operator()(DB::AsyncLoader&, std::shared_ptr const&) const @ 0x000000001a0e0c63 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a0e0be5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a0e0ba5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a0e0b65 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a0e0b30 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000135ff446 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000135f5ac5 29. /build/src/Common/AsyncLoader.cpp:169: DB::LoadJob::execute(DB::AsyncLoader&, unsigned long, std::shared_ptr const&) @ 0x00000000135e790b 30. /build/src/Common/AsyncLoader.cpp:937: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f3f67 31. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock&)::$_1::operator()() const @ 0x00000000135f52dc (version 24.3.12.76.altinitystable). (ASYNC_LOAD_FAILED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String const&, String&&) @ 0x000000000b4fe4cc 6. /build/src/Common/AsyncLoader.cpp:942: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f415d 7. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock&)::$_1::operator()() const @ 0x00000000135f52dc 8. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000135f52b5 9. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000135f5295 10. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000135f5275 11. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000135f523d 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 14. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 15. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 17. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 18. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 19. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 20. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 26. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 27. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 29. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 30. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 31. ? @ 0x00007fd3ce7a5ac3 (version 24.3.12.76.altinitystable) 2024.12.16 12:07:12.680563 [ 10365 ] {} Context: Server was built in debug mode. It will work slowly. 2024.12.16 12:07:12.711128 [ 10365 ] {} Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production. 2024.12.16 12:07:12.712277 [ 10365 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2024.12.16 12:07:12.714972 [ 10365 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2024.12.16 12:07:12.715121 [ 10365 ] {} Application: Integrity check of the executable skipped because the reference checksum could not be read. 2024.12.16 12:07:15.096630 [ 10365 ] {} CloudPlacementInfo: Placement info has not been loaded 2024.12.16 12:07:15.498876 [ 10365 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2024.12.16 12:07:15.504450 [ 10365 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2024.12.16 12:07:15.504554 [ 10365 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2024.12.16 12:07:15.556006 [ 11009 ] {} RaftInstance: Election timeout, initiate leader election 2024.12.16 12:07:17.983175 [ 10365 ] {} Context: Table system.session_log is enabled. It's unreliable and may contain garbage. Do not use it for any kind of security monitoring. 2024.12.16 12:07:18.580005 [ 10365 ] {} Context: Server has databases (for example `test_ip6kl7xs_3`) with Ordinary engine, which was deprecated. To convert this database to the new Atomic engine, create a flag /var/lib/clickhouse/flags/convert_ordinary_to_atomic and make sure that ClickHouse has write permission for it. Example: sudo touch '/var/lib/clickhouse/flags/convert_ordinary_to_atomic' && sudo chmod 666 '/var/lib/clickhouse/flags/convert_ordinary_to_atomic' 2024.12.16 12:07:19.082353 [ 11142 ] {} void DB::AsyncLoader::worker(Pool &): Code: 1. DB::Exception: Experimental WINDOW VIEW feature is not supported with new infrastructure for query analysis (the setting 'allow_experimental_analyzer'): Cannot attach table `test_1`.`wv` from metadata file /var/lib/clickhouse/store/a78/a7828c9b-5200-481c-ac66-4570598f91a1/wv.sql from query ATTACH WINDOW VIEW test_1.wv UUID 'a2de7aa9-7124-4016-995e-d12992706b6f' TO test_1.dst (`count` UInt64, `market` Int32, `w_end` DateTime('US/Samoa')) WATERMARK ASCENDING AS SELECT count(a) AS count, market, tumbleEnd(wid) AS w_end FROM test_1.mt GROUP BY tumble(timestamp, toIntervalSecond('5'), 'US/Samoa') AS wid, market. (UNSUPPORTED_METHOD), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f4eb7 6. /build/src/Storages/WindowView/StorageWindowView.cpp:1181: DB::StorageWindowView::StorageWindowView(DB::StorageID const&, std::shared_ptr, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel) @ 0x000000001d170c0d 7. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageWindowView* std::construct_at[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, DB::StorageWindowView*>(DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a5e3 8. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void, void>(std::allocator&, DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a361 9. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&>(std::allocator, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a02d 10. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, std::shared_ptr, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(std::allocator const&, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189e7a 11. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189e06 12. /build/src/Storages/WindowView/StorageWindowView.cpp:1693: DB::registerStorageWindowView(DB::StorageFactory&)::$_0::operator()(DB::StorageFactory::Arguments const&) const @ 0x000000001d17d7a6 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d17d61d 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001d17d5bd 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d17d57d 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d17d545 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001c3709de 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001c36f2fd 19. /build/src/Storages/StorageFactory.cpp:224: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, DB::LoadingStrictnessLevel) const @ 0x000000001c36dc1d 20. /build/src/Databases/DatabaseOnDisk.cpp:120: DB::createTableFromAST(DB::ASTCreateQuery, String const&, String const&, std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000001a0b0752 21. /build/src/Databases/DatabaseOrdinary.cpp:248: DB::DatabaseOrdinary::loadTableFromMetadata(std::shared_ptr, String const&, DB::QualifiedTableName const&, std::shared_ptr const&, DB::LoadingStrictnessLevel) @ 0x000000001a0d947b 22. /build/src/Databases/DatabaseOrdinary.cpp:283: DB::DatabaseOrdinary::loadTableFromMetadataAsync(DB::AsyncLoader&, std::unordered_set, std::hash>, std::equal_to>, std::allocator>>, std::shared_ptr, String const&, DB::QualifiedTableName const&, std::shared_ptr const&, DB::LoadingStrictnessLevel)::$_0::operator()(DB::AsyncLoader&, std::shared_ptr const&) const @ 0x000000001a0e0c63 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a0e0be5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a0e0ba5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a0e0b65 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a0e0b30 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000135ff446 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000135f5ac5 29. /build/src/Common/AsyncLoader.cpp:169: DB::LoadJob::execute(DB::AsyncLoader&, unsigned long, std::shared_ptr const&) @ 0x00000000135e790b 30. /build/src/Common/AsyncLoader.cpp:937: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f3f67 31. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock&)::$_1::operator()() const @ 0x00000000135f52dc (version 24.3.12.76.altinitystable) 2024.12.16 12:07:19.170501 [ 10365 ] {} Application: Caught exception while loading metadata: Code: 695. DB::Exception: Load job 'load table test_1.wv' failed: Code: 1. DB::Exception: Experimental WINDOW VIEW feature is not supported with new infrastructure for query analysis (the setting 'allow_experimental_analyzer'): Cannot attach table `test_1`.`wv` from metadata file /var/lib/clickhouse/store/a78/a7828c9b-5200-481c-ac66-4570598f91a1/wv.sql from query ATTACH WINDOW VIEW test_1.wv UUID 'a2de7aa9-7124-4016-995e-d12992706b6f' TO test_1.dst (`count` UInt64, `market` Int32, `w_end` DateTime('US/Samoa')) WATERMARK ASCENDING AS SELECT count(a) AS count, market, tumbleEnd(wid) AS w_end FROM test_1.mt GROUP BY tumble(timestamp, toIntervalSecond('5'), 'US/Samoa') AS wid, market. (UNSUPPORTED_METHOD), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f4eb7 6. /build/src/Storages/WindowView/StorageWindowView.cpp:1181: DB::StorageWindowView::StorageWindowView(DB::StorageID const&, std::shared_ptr, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel) @ 0x000000001d170c0d 7. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageWindowView* std::construct_at[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, DB::StorageWindowView*>(DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a5e3 8. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void, void>(std::allocator&, DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a361 9. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&>(std::allocator, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a02d 10. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, std::shared_ptr, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(std::allocator const&, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189e7a 11. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189e06 12. /build/src/Storages/WindowView/StorageWindowView.cpp:1693: DB::registerStorageWindowView(DB::StorageFactory&)::$_0::operator()(DB::StorageFactory::Arguments const&) const @ 0x000000001d17d7a6 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d17d61d 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001d17d5bd 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d17d57d 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d17d545 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001c3709de 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001c36f2fd 19. /build/src/Storages/StorageFactory.cpp:224: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, DB::LoadingStrictnessLevel) const @ 0x000000001c36dc1d 20. /build/src/Databases/DatabaseOnDisk.cpp:120: DB::createTableFromAST(DB::ASTCreateQuery, String const&, String const&, std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000001a0b0752 21. /build/src/Databases/DatabaseOrdinary.cpp:248: DB::DatabaseOrdinary::loadTableFromMetadata(std::shared_ptr, String const&, DB::QualifiedTableName const&, std::shared_ptr const&, DB::LoadingStrictnessLevel) @ 0x000000001a0d947b 22. /build/src/Databases/DatabaseOrdinary.cpp:283: DB::DatabaseOrdinary::loadTableFromMetadataAsync(DB::AsyncLoader&, std::unordered_set, std::hash>, std::equal_to>, std::allocator>>, std::shared_ptr, String const&, DB::QualifiedTableName const&, std::shared_ptr const&, DB::LoadingStrictnessLevel)::$_0::operator()(DB::AsyncLoader&, std::shared_ptr const&) const @ 0x000000001a0e0c63 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a0e0be5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a0e0ba5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a0e0b65 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a0e0b30 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000135ff446 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000135f5ac5 29. /build/src/Common/AsyncLoader.cpp:169: DB::LoadJob::execute(DB::AsyncLoader&, unsigned long, std::shared_ptr const&) @ 0x00000000135e790b 30. /build/src/Common/AsyncLoader.cpp:937: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f3f67 31. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock&)::$_1::operator()() const @ 0x00000000135f52dc (version 24.3.12.76.altinitystable). (ASYNC_LOAD_FAILED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String const&, String&&) @ 0x000000000b4fe4cc 6. /build/src/Common/AsyncLoader.cpp:942: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f415d 7. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock&)::$_1::operator()() const @ 0x00000000135f52dc 8. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000135f52b5 9. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000135f5295 10. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000135f5275 11. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000135f523d 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 14. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 15. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 17. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 18. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 19. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 20. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 26. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 27. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 29. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 30. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 31. ? @ 0x00007f9b61794ac3 (version 24.3.12.76.altinitystable) 2024.12.16 12:07:24.608941 [ 10365 ] {} Application: Code: 695. DB::Exception: Load job 'load table test_1.wv' failed: Code: 1. DB::Exception: Experimental WINDOW VIEW feature is not supported with new infrastructure for query analysis (the setting 'allow_experimental_analyzer'): Cannot attach table `test_1`.`wv` from metadata file /var/lib/clickhouse/store/a78/a7828c9b-5200-481c-ac66-4570598f91a1/wv.sql from query ATTACH WINDOW VIEW test_1.wv UUID 'a2de7aa9-7124-4016-995e-d12992706b6f' TO test_1.dst (`count` UInt64, `market` Int32, `w_end` DateTime('US/Samoa')) WATERMARK ASCENDING AS SELECT count(a) AS count, market, tumbleEnd(wid) AS w_end FROM test_1.mt GROUP BY tumble(timestamp, toIntervalSecond('5'), 'US/Samoa') AS wid, market. (UNSUPPORTED_METHOD), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f4eb7 6. /build/src/Storages/WindowView/StorageWindowView.cpp:1181: DB::StorageWindowView::StorageWindowView(DB::StorageID const&, std::shared_ptr, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel) @ 0x000000001d170c0d 7. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageWindowView* std::construct_at[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, DB::StorageWindowView*>(DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a5e3 8. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void, void>(std::allocator&, DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a361 9. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&>(std::allocator, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a02d 10. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, std::shared_ptr, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(std::allocator const&, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189e7a 11. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189e06 12. /build/src/Storages/WindowView/StorageWindowView.cpp:1693: DB::registerStorageWindowView(DB::StorageFactory&)::$_0::operator()(DB::StorageFactory::Arguments const&) const @ 0x000000001d17d7a6 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d17d61d 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001d17d5bd 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d17d57d 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d17d545 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001c3709de 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001c36f2fd 19. /build/src/Storages/StorageFactory.cpp:224: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, DB::LoadingStrictnessLevel) const @ 0x000000001c36dc1d 20. /build/src/Databases/DatabaseOnDisk.cpp:120: DB::createTableFromAST(DB::ASTCreateQuery, String const&, String const&, std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000001a0b0752 21. /build/src/Databases/DatabaseOrdinary.cpp:248: DB::DatabaseOrdinary::loadTableFromMetadata(std::shared_ptr, String const&, DB::QualifiedTableName const&, std::shared_ptr const&, DB::LoadingStrictnessLevel) @ 0x000000001a0d947b 22. /build/src/Databases/DatabaseOrdinary.cpp:283: DB::DatabaseOrdinary::loadTableFromMetadataAsync(DB::AsyncLoader&, std::unordered_set, std::hash>, std::equal_to>, std::allocator>>, std::shared_ptr, String const&, DB::QualifiedTableName const&, std::shared_ptr const&, DB::LoadingStrictnessLevel)::$_0::operator()(DB::AsyncLoader&, std::shared_ptr const&) const @ 0x000000001a0e0c63 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a0e0be5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a0e0ba5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a0e0b65 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a0e0b30 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000135ff446 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000135f5ac5 29. /build/src/Common/AsyncLoader.cpp:169: DB::LoadJob::execute(DB::AsyncLoader&, unsigned long, std::shared_ptr const&) @ 0x00000000135e790b 30. /build/src/Common/AsyncLoader.cpp:937: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f3f67 31. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock&)::$_1::operator()() const @ 0x00000000135f52dc (version 24.3.12.76.altinitystable). (ASYNC_LOAD_FAILED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String const&, String&&) @ 0x000000000b4fe4cc 6. /build/src/Common/AsyncLoader.cpp:942: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f415d 7. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock&)::$_1::operator()() const @ 0x00000000135f52dc 8. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000135f52b5 9. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000135f5295 10. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000135f5275 11. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000135f523d 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 14. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 15. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 17. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 18. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 19. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 20. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 26. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 27. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 29. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 30. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 31. ? @ 0x00007f9b61794ac3 (version 24.3.12.76.altinitystable) 2024.12.16 12:07:26.418769 [ 11182 ] {} Context: Server was built in debug mode. It will work slowly. 2024.12.16 12:07:26.449445 [ 11182 ] {} Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production. 2024.12.16 12:07:26.450560 [ 11182 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2024.12.16 12:07:26.453218 [ 11182 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2024.12.16 12:07:26.453358 [ 11182 ] {} Application: Integrity check of the executable skipped because the reference checksum could not be read. 2024.12.16 12:07:28.870651 [ 11182 ] {} CloudPlacementInfo: Placement info has not been loaded 2024.12.16 12:07:29.298781 [ 11182 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2024.12.16 12:07:29.304465 [ 11182 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2024.12.16 12:07:29.304561 [ 11182 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2024.12.16 12:07:29.356322 [ 11826 ] {} RaftInstance: Election timeout, initiate leader election 2024.12.16 12:07:31.734716 [ 11182 ] {} Context: Table system.session_log is enabled. It's unreliable and may contain garbage. Do not use it for any kind of security monitoring. 2024.12.16 12:07:32.348372 [ 11182 ] {} Context: Server has databases (for example `test_ip6kl7xs_3`) with Ordinary engine, which was deprecated. To convert this database to the new Atomic engine, create a flag /var/lib/clickhouse/flags/convert_ordinary_to_atomic and make sure that ClickHouse has write permission for it. Example: sudo touch '/var/lib/clickhouse/flags/convert_ordinary_to_atomic' && sudo chmod 666 '/var/lib/clickhouse/flags/convert_ordinary_to_atomic' 2024.12.16 12:07:32.883493 [ 11940 ] {} void DB::AsyncLoader::worker(Pool &): Code: 1. DB::Exception: Experimental WINDOW VIEW feature is not supported with new infrastructure for query analysis (the setting 'allow_experimental_analyzer'): Cannot attach table `test_1`.`wv` from metadata file /var/lib/clickhouse/store/a78/a7828c9b-5200-481c-ac66-4570598f91a1/wv.sql from query ATTACH WINDOW VIEW test_1.wv UUID 'a2de7aa9-7124-4016-995e-d12992706b6f' TO test_1.dst (`count` UInt64, `market` Int32, `w_end` DateTime('US/Samoa')) WATERMARK ASCENDING AS SELECT count(a) AS count, market, tumbleEnd(wid) AS w_end FROM test_1.mt GROUP BY tumble(timestamp, toIntervalSecond('5'), 'US/Samoa') AS wid, market. (UNSUPPORTED_METHOD), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f4eb7 6. /build/src/Storages/WindowView/StorageWindowView.cpp:1181: DB::StorageWindowView::StorageWindowView(DB::StorageID const&, std::shared_ptr, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel) @ 0x000000001d170c0d 7. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageWindowView* std::construct_at[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, DB::StorageWindowView*>(DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a5e3 8. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void, void>(std::allocator&, DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a361 9. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&>(std::allocator, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a02d 10. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, std::shared_ptr, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(std::allocator const&, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189e7a 11. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189e06 12. /build/src/Storages/WindowView/StorageWindowView.cpp:1693: DB::registerStorageWindowView(DB::StorageFactory&)::$_0::operator()(DB::StorageFactory::Arguments const&) const @ 0x000000001d17d7a6 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d17d61d 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001d17d5bd 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d17d57d 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d17d545 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001c3709de 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001c36f2fd 19. /build/src/Storages/StorageFactory.cpp:224: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, DB::LoadingStrictnessLevel) const @ 0x000000001c36dc1d 20. /build/src/Databases/DatabaseOnDisk.cpp:120: DB::createTableFromAST(DB::ASTCreateQuery, String const&, String const&, std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000001a0b0752 21. /build/src/Databases/DatabaseOrdinary.cpp:248: DB::DatabaseOrdinary::loadTableFromMetadata(std::shared_ptr, String const&, DB::QualifiedTableName const&, std::shared_ptr const&, DB::LoadingStrictnessLevel) @ 0x000000001a0d947b 22. /build/src/Databases/DatabaseOrdinary.cpp:283: DB::DatabaseOrdinary::loadTableFromMetadataAsync(DB::AsyncLoader&, std::unordered_set, std::hash>, std::equal_to>, std::allocator>>, std::shared_ptr, String const&, DB::QualifiedTableName const&, std::shared_ptr const&, DB::LoadingStrictnessLevel)::$_0::operator()(DB::AsyncLoader&, std::shared_ptr const&) const @ 0x000000001a0e0c63 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a0e0be5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a0e0ba5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a0e0b65 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a0e0b30 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000135ff446 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000135f5ac5 29. /build/src/Common/AsyncLoader.cpp:169: DB::LoadJob::execute(DB::AsyncLoader&, unsigned long, std::shared_ptr const&) @ 0x00000000135e790b 30. /build/src/Common/AsyncLoader.cpp:937: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f3f67 31. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock&)::$_1::operator()() const @ 0x00000000135f52dc (version 24.3.12.76.altinitystable) 2024.12.16 12:07:32.961802 [ 11182 ] {} Application: Caught exception while loading metadata: Code: 695. DB::Exception: Load job 'load table test_1.wv' failed: Code: 1. DB::Exception: Experimental WINDOW VIEW feature is not supported with new infrastructure for query analysis (the setting 'allow_experimental_analyzer'): Cannot attach table `test_1`.`wv` from metadata file /var/lib/clickhouse/store/a78/a7828c9b-5200-481c-ac66-4570598f91a1/wv.sql from query ATTACH WINDOW VIEW test_1.wv UUID 'a2de7aa9-7124-4016-995e-d12992706b6f' TO test_1.dst (`count` UInt64, `market` Int32, `w_end` DateTime('US/Samoa')) WATERMARK ASCENDING AS SELECT count(a) AS count, market, tumbleEnd(wid) AS w_end FROM test_1.mt GROUP BY tumble(timestamp, toIntervalSecond('5'), 'US/Samoa') AS wid, market. (UNSUPPORTED_METHOD), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f4eb7 6. /build/src/Storages/WindowView/StorageWindowView.cpp:1181: DB::StorageWindowView::StorageWindowView(DB::StorageID const&, std::shared_ptr, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel) @ 0x000000001d170c0d 7. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageWindowView* std::construct_at[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, DB::StorageWindowView*>(DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a5e3 8. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void, void>(std::allocator&, DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a361 9. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&>(std::allocator, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a02d 10. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, std::shared_ptr, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(std::allocator const&, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189e7a 11. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189e06 12. /build/src/Storages/WindowView/StorageWindowView.cpp:1693: DB::registerStorageWindowView(DB::StorageFactory&)::$_0::operator()(DB::StorageFactory::Arguments const&) const @ 0x000000001d17d7a6 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d17d61d 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001d17d5bd 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d17d57d 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d17d545 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001c3709de 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001c36f2fd 19. /build/src/Storages/StorageFactory.cpp:224: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, DB::LoadingStrictnessLevel) const @ 0x000000001c36dc1d 20. /build/src/Databases/DatabaseOnDisk.cpp:120: DB::createTableFromAST(DB::ASTCreateQuery, String const&, String const&, std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000001a0b0752 21. /build/src/Databases/DatabaseOrdinary.cpp:248: DB::DatabaseOrdinary::loadTableFromMetadata(std::shared_ptr, String const&, DB::QualifiedTableName const&, std::shared_ptr const&, DB::LoadingStrictnessLevel) @ 0x000000001a0d947b 22. /build/src/Databases/DatabaseOrdinary.cpp:283: DB::DatabaseOrdinary::loadTableFromMetadataAsync(DB::AsyncLoader&, std::unordered_set, std::hash>, std::equal_to>, std::allocator>>, std::shared_ptr, String const&, DB::QualifiedTableName const&, std::shared_ptr const&, DB::LoadingStrictnessLevel)::$_0::operator()(DB::AsyncLoader&, std::shared_ptr const&) const @ 0x000000001a0e0c63 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a0e0be5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a0e0ba5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a0e0b65 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a0e0b30 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000135ff446 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000135f5ac5 29. /build/src/Common/AsyncLoader.cpp:169: DB::LoadJob::execute(DB::AsyncLoader&, unsigned long, std::shared_ptr const&) @ 0x00000000135e790b 30. /build/src/Common/AsyncLoader.cpp:937: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f3f67 31. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock&)::$_1::operator()() const @ 0x00000000135f52dc (version 24.3.12.76.altinitystable). (ASYNC_LOAD_FAILED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String const&, String&&) @ 0x000000000b4fe4cc 6. /build/src/Common/AsyncLoader.cpp:942: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f415d 7. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock&)::$_1::operator()() const @ 0x00000000135f52dc 8. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000135f52b5 9. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000135f5295 10. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000135f5275 11. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000135f523d 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 14. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 15. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 17. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 18. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 19. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 20. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 26. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 27. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 29. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 30. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 31. ? @ 0x00007f23dfc5dac3 (version 24.3.12.76.altinitystable) 2024.12.16 12:07:37.878066 [ 11829 ] {} RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled 2024.12.16 12:07:38.368607 [ 11182 ] {} Application: Code: 695. DB::Exception: Load job 'load table test_1.wv' failed: Code: 1. DB::Exception: Experimental WINDOW VIEW feature is not supported with new infrastructure for query analysis (the setting 'allow_experimental_analyzer'): Cannot attach table `test_1`.`wv` from metadata file /var/lib/clickhouse/store/a78/a7828c9b-5200-481c-ac66-4570598f91a1/wv.sql from query ATTACH WINDOW VIEW test_1.wv UUID 'a2de7aa9-7124-4016-995e-d12992706b6f' TO test_1.dst (`count` UInt64, `market` Int32, `w_end` DateTime('US/Samoa')) WATERMARK ASCENDING AS SELECT count(a) AS count, market, tumbleEnd(wid) AS w_end FROM test_1.mt GROUP BY tumble(timestamp, toIntervalSecond('5'), 'US/Samoa') AS wid, market. (UNSUPPORTED_METHOD), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f4eb7 6. /build/src/Storages/WindowView/StorageWindowView.cpp:1181: DB::StorageWindowView::StorageWindowView(DB::StorageID const&, std::shared_ptr, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel) @ 0x000000001d170c0d 7. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageWindowView* std::construct_at[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, DB::StorageWindowView*>(DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a5e3 8. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void, void>(std::allocator&, DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a361 9. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&>(std::allocator, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a02d 10. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, std::shared_ptr, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(std::allocator const&, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189e7a 11. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189e06 12. /build/src/Storages/WindowView/StorageWindowView.cpp:1693: DB::registerStorageWindowView(DB::StorageFactory&)::$_0::operator()(DB::StorageFactory::Arguments const&) const @ 0x000000001d17d7a6 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d17d61d 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001d17d5bd 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d17d57d 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d17d545 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001c3709de 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001c36f2fd 19. /build/src/Storages/StorageFactory.cpp:224: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, DB::LoadingStrictnessLevel) const @ 0x000000001c36dc1d 20. /build/src/Databases/DatabaseOnDisk.cpp:120: DB::createTableFromAST(DB::ASTCreateQuery, String const&, String const&, std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000001a0b0752 21. /build/src/Databases/DatabaseOrdinary.cpp:248: DB::DatabaseOrdinary::loadTableFromMetadata(std::shared_ptr, String const&, DB::QualifiedTableName const&, std::shared_ptr const&, DB::LoadingStrictnessLevel) @ 0x000000001a0d947b 22. /build/src/Databases/DatabaseOrdinary.cpp:283: DB::DatabaseOrdinary::loadTableFromMetadataAsync(DB::AsyncLoader&, std::unordered_set, std::hash>, std::equal_to>, std::allocator>>, std::shared_ptr, String const&, DB::QualifiedTableName const&, std::shared_ptr const&, DB::LoadingStrictnessLevel)::$_0::operator()(DB::AsyncLoader&, std::shared_ptr const&) const @ 0x000000001a0e0c63 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a0e0be5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a0e0ba5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a0e0b65 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a0e0b30 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000135ff446 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000135f5ac5 29. /build/src/Common/AsyncLoader.cpp:169: DB::LoadJob::execute(DB::AsyncLoader&, unsigned long, std::shared_ptr const&) @ 0x00000000135e790b 30. /build/src/Common/AsyncLoader.cpp:937: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f3f67 31. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock&)::$_1::operator()() const @ 0x00000000135f52dc (version 24.3.12.76.altinitystable). (ASYNC_LOAD_FAILED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String const&, String&&) @ 0x000000000b4fe4cc 6. /build/src/Common/AsyncLoader.cpp:942: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f415d 7. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock&)::$_1::operator()() const @ 0x00000000135f52dc 8. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000135f52b5 9. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000135f5295 10. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000135f5275 11. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000135f523d 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 14. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 15. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 17. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 18. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 19. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 20. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 26. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 27. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 29. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 30. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 31. ? @ 0x00007f23dfc5dac3 (version 24.3.12.76.altinitystable) 2024.12.16 12:07:40.387294 [ 12005 ] {} Context: Server was built in debug mode. It will work slowly. 2024.12.16 12:07:40.417733 [ 12005 ] {} Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production. 2024.12.16 12:07:40.418980 [ 12005 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2024.12.16 12:07:40.421616 [ 12005 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2024.12.16 12:07:40.421756 [ 12005 ] {} Application: Integrity check of the executable skipped because the reference checksum could not be read. 2024.12.16 12:07:42.890870 [ 12005 ] {} CloudPlacementInfo: Placement info has not been loaded 2024.12.16 12:07:43.313754 [ 12005 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2024.12.16 12:07:43.319538 [ 12005 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2024.12.16 12:07:43.319634 [ 12005 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2024.12.16 12:07:43.371440 [ 12650 ] {} RaftInstance: Election timeout, initiate leader election 2024.12.16 12:07:45.737494 [ 12005 ] {} Context: Table system.session_log is enabled. It's unreliable and may contain garbage. Do not use it for any kind of security monitoring. 2024.12.16 12:07:46.271229 [ 12005 ] {} Context: Server has databases (for example `test_ip6kl7xs_3`) with Ordinary engine, which was deprecated. To convert this database to the new Atomic engine, create a flag /var/lib/clickhouse/flags/convert_ordinary_to_atomic and make sure that ClickHouse has write permission for it. Example: sudo touch '/var/lib/clickhouse/flags/convert_ordinary_to_atomic' && sudo chmod 666 '/var/lib/clickhouse/flags/convert_ordinary_to_atomic' 2024.12.16 12:07:46.807455 [ 12834 ] {} void DB::AsyncLoader::worker(Pool &): Code: 1. DB::Exception: Experimental WINDOW VIEW feature is not supported with new infrastructure for query analysis (the setting 'allow_experimental_analyzer'): Cannot attach table `test_1`.`wv` from metadata file /var/lib/clickhouse/store/a78/a7828c9b-5200-481c-ac66-4570598f91a1/wv.sql from query ATTACH WINDOW VIEW test_1.wv UUID 'a2de7aa9-7124-4016-995e-d12992706b6f' TO test_1.dst (`count` UInt64, `market` Int32, `w_end` DateTime('US/Samoa')) WATERMARK ASCENDING AS SELECT count(a) AS count, market, tumbleEnd(wid) AS w_end FROM test_1.mt GROUP BY tumble(timestamp, toIntervalSecond('5'), 'US/Samoa') AS wid, market. (UNSUPPORTED_METHOD), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f4eb7 6. /build/src/Storages/WindowView/StorageWindowView.cpp:1181: DB::StorageWindowView::StorageWindowView(DB::StorageID const&, std::shared_ptr, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel) @ 0x000000001d170c0d 7. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageWindowView* std::construct_at[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, DB::StorageWindowView*>(DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a5e3 8. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void, void>(std::allocator&, DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a361 9. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&>(std::allocator, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a02d 10. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, std::shared_ptr, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(std::allocator const&, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189e7a 11. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189e06 12. /build/src/Storages/WindowView/StorageWindowView.cpp:1693: DB::registerStorageWindowView(DB::StorageFactory&)::$_0::operator()(DB::StorageFactory::Arguments const&) const @ 0x000000001d17d7a6 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d17d61d 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001d17d5bd 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d17d57d 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d17d545 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001c3709de 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001c36f2fd 19. /build/src/Storages/StorageFactory.cpp:224: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, DB::LoadingStrictnessLevel) const @ 0x000000001c36dc1d 20. /build/src/Databases/DatabaseOnDisk.cpp:120: DB::createTableFromAST(DB::ASTCreateQuery, String const&, String const&, std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000001a0b0752 21. /build/src/Databases/DatabaseOrdinary.cpp:248: DB::DatabaseOrdinary::loadTableFromMetadata(std::shared_ptr, String const&, DB::QualifiedTableName const&, std::shared_ptr const&, DB::LoadingStrictnessLevel) @ 0x000000001a0d947b 22. /build/src/Databases/DatabaseOrdinary.cpp:283: DB::DatabaseOrdinary::loadTableFromMetadataAsync(DB::AsyncLoader&, std::unordered_set, std::hash>, std::equal_to>, std::allocator>>, std::shared_ptr, String const&, DB::QualifiedTableName const&, std::shared_ptr const&, DB::LoadingStrictnessLevel)::$_0::operator()(DB::AsyncLoader&, std::shared_ptr const&) const @ 0x000000001a0e0c63 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a0e0be5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a0e0ba5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a0e0b65 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a0e0b30 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000135ff446 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000135f5ac5 29. /build/src/Common/AsyncLoader.cpp:169: DB::LoadJob::execute(DB::AsyncLoader&, unsigned long, std::shared_ptr const&) @ 0x00000000135e790b 30. /build/src/Common/AsyncLoader.cpp:937: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f3f67 31. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock&)::$_1::operator()() const @ 0x00000000135f52dc (version 24.3.12.76.altinitystable) 2024.12.16 12:07:46.931641 [ 12005 ] {} Application: Caught exception while loading metadata: Code: 695. DB::Exception: Load job 'load table test_1.wv' failed: Code: 1. DB::Exception: Experimental WINDOW VIEW feature is not supported with new infrastructure for query analysis (the setting 'allow_experimental_analyzer'): Cannot attach table `test_1`.`wv` from metadata file /var/lib/clickhouse/store/a78/a7828c9b-5200-481c-ac66-4570598f91a1/wv.sql from query ATTACH WINDOW VIEW test_1.wv UUID 'a2de7aa9-7124-4016-995e-d12992706b6f' TO test_1.dst (`count` UInt64, `market` Int32, `w_end` DateTime('US/Samoa')) WATERMARK ASCENDING AS SELECT count(a) AS count, market, tumbleEnd(wid) AS w_end FROM test_1.mt GROUP BY tumble(timestamp, toIntervalSecond('5'), 'US/Samoa') AS wid, market. (UNSUPPORTED_METHOD), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f4eb7 6. /build/src/Storages/WindowView/StorageWindowView.cpp:1181: DB::StorageWindowView::StorageWindowView(DB::StorageID const&, std::shared_ptr, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel) @ 0x000000001d170c0d 7. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageWindowView* std::construct_at[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, DB::StorageWindowView*>(DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a5e3 8. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void, void>(std::allocator&, DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a361 9. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&>(std::allocator, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a02d 10. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, std::shared_ptr, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(std::allocator const&, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189e7a 11. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189e06 12. /build/src/Storages/WindowView/StorageWindowView.cpp:1693: DB::registerStorageWindowView(DB::StorageFactory&)::$_0::operator()(DB::StorageFactory::Arguments const&) const @ 0x000000001d17d7a6 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d17d61d 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001d17d5bd 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d17d57d 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d17d545 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001c3709de 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001c36f2fd 19. /build/src/Storages/StorageFactory.cpp:224: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, DB::LoadingStrictnessLevel) const @ 0x000000001c36dc1d 20. /build/src/Databases/DatabaseOnDisk.cpp:120: DB::createTableFromAST(DB::ASTCreateQuery, String const&, String const&, std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000001a0b0752 21. /build/src/Databases/DatabaseOrdinary.cpp:248: DB::DatabaseOrdinary::loadTableFromMetadata(std::shared_ptr, String const&, DB::QualifiedTableName const&, std::shared_ptr const&, DB::LoadingStrictnessLevel) @ 0x000000001a0d947b 22. /build/src/Databases/DatabaseOrdinary.cpp:283: DB::DatabaseOrdinary::loadTableFromMetadataAsync(DB::AsyncLoader&, std::unordered_set, std::hash>, std::equal_to>, std::allocator>>, std::shared_ptr, String const&, DB::QualifiedTableName const&, std::shared_ptr const&, DB::LoadingStrictnessLevel)::$_0::operator()(DB::AsyncLoader&, std::shared_ptr const&) const @ 0x000000001a0e0c63 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a0e0be5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a0e0ba5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a0e0b65 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a0e0b30 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000135ff446 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000135f5ac5 29. /build/src/Common/AsyncLoader.cpp:169: DB::LoadJob::execute(DB::AsyncLoader&, unsigned long, std::shared_ptr const&) @ 0x00000000135e790b 30. /build/src/Common/AsyncLoader.cpp:937: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f3f67 31. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock&)::$_1::operator()() const @ 0x00000000135f52dc (version 24.3.12.76.altinitystable). (ASYNC_LOAD_FAILED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String const&, String&&) @ 0x000000000b4fe4cc 6. /build/src/Common/AsyncLoader.cpp:942: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f415d 7. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock&)::$_1::operator()() const @ 0x00000000135f52dc 8. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000135f52b5 9. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000135f5295 10. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000135f5275 11. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000135f523d 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 14. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 15. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 17. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 18. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 19. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 20. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 26. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 27. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 29. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 30. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 31. ? @ 0x00007fce6b0c6ac3 (version 24.3.12.76.altinitystable) 2024.12.16 12:07:54.446085 [ 12005 ] {} Application: Code: 695. DB::Exception: Load job 'load table test_1.wv' failed: Code: 1. DB::Exception: Experimental WINDOW VIEW feature is not supported with new infrastructure for query analysis (the setting 'allow_experimental_analyzer'): Cannot attach table `test_1`.`wv` from metadata file /var/lib/clickhouse/store/a78/a7828c9b-5200-481c-ac66-4570598f91a1/wv.sql from query ATTACH WINDOW VIEW test_1.wv UUID 'a2de7aa9-7124-4016-995e-d12992706b6f' TO test_1.dst (`count` UInt64, `market` Int32, `w_end` DateTime('US/Samoa')) WATERMARK ASCENDING AS SELECT count(a) AS count, market, tumbleEnd(wid) AS w_end FROM test_1.mt GROUP BY tumble(timestamp, toIntervalSecond('5'), 'US/Samoa') AS wid, market. (UNSUPPORTED_METHOD), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f4eb7 6. /build/src/Storages/WindowView/StorageWindowView.cpp:1181: DB::StorageWindowView::StorageWindowView(DB::StorageID const&, std::shared_ptr, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel) @ 0x000000001d170c0d 7. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageWindowView* std::construct_at[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, DB::StorageWindowView*>(DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a5e3 8. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void, void>(std::allocator&, DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a361 9. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&>(std::allocator, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a02d 10. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, std::shared_ptr, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(std::allocator const&, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189e7a 11. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189e06 12. /build/src/Storages/WindowView/StorageWindowView.cpp:1693: DB::registerStorageWindowView(DB::StorageFactory&)::$_0::operator()(DB::StorageFactory::Arguments const&) const @ 0x000000001d17d7a6 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d17d61d 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001d17d5bd 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d17d57d 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d17d545 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001c3709de 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001c36f2fd 19. /build/src/Storages/StorageFactory.cpp:224: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, DB::LoadingStrictnessLevel) const @ 0x000000001c36dc1d 20. /build/src/Databases/DatabaseOnDisk.cpp:120: DB::createTableFromAST(DB::ASTCreateQuery, String const&, String const&, std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000001a0b0752 21. /build/src/Databases/DatabaseOrdinary.cpp:248: DB::DatabaseOrdinary::loadTableFromMetadata(std::shared_ptr, String const&, DB::QualifiedTableName const&, std::shared_ptr const&, DB::LoadingStrictnessLevel) @ 0x000000001a0d947b 22. /build/src/Databases/DatabaseOrdinary.cpp:283: DB::DatabaseOrdinary::loadTableFromMetadataAsync(DB::AsyncLoader&, std::unordered_set, std::hash>, std::equal_to>, std::allocator>>, std::shared_ptr, String const&, DB::QualifiedTableName const&, std::shared_ptr const&, DB::LoadingStrictnessLevel)::$_0::operator()(DB::AsyncLoader&, std::shared_ptr const&) const @ 0x000000001a0e0c63 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a0e0be5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a0e0ba5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a0e0b65 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a0e0b30 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000135ff446 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000135f5ac5 29. /build/src/Common/AsyncLoader.cpp:169: DB::LoadJob::execute(DB::AsyncLoader&, unsigned long, std::shared_ptr const&) @ 0x00000000135e790b 30. /build/src/Common/AsyncLoader.cpp:937: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f3f67 31. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock&)::$_1::operator()() const @ 0x00000000135f52dc (version 24.3.12.76.altinitystable). (ASYNC_LOAD_FAILED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String const&, String&&) @ 0x000000000b4fe4cc 6. /build/src/Common/AsyncLoader.cpp:942: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f415d 7. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock&)::$_1::operator()() const @ 0x00000000135f52dc 8. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000135f52b5 9. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000135f5295 10. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000135f5275 11. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000135f523d 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 14. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 15. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 17. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 18. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 19. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 20. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 26. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 27. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 29. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 30. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 31. ? @ 0x00007fce6b0c6ac3 (version 24.3.12.76.altinitystable) 2024.12.16 12:07:56.295091 [ 12887 ] {} Context: Server was built in debug mode. It will work slowly. 2024.12.16 12:07:56.325878 [ 12887 ] {} Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production. 2024.12.16 12:07:56.327152 [ 12887 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2024.12.16 12:07:56.329821 [ 12887 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2024.12.16 12:07:56.329965 [ 12887 ] {} Application: Integrity check of the executable skipped because the reference checksum could not be read. 2024.12.16 12:07:58.851449 [ 12887 ] {} CloudPlacementInfo: Placement info has not been loaded 2024.12.16 12:07:59.272751 [ 12887 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2024.12.16 12:07:59.278681 [ 12887 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2024.12.16 12:07:59.278780 [ 12887 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2024.12.16 12:07:59.330437 [ 13532 ] {} RaftInstance: Election timeout, initiate leader election 2024.12.16 12:08:01.784297 [ 12887 ] {} Context: Table system.session_log is enabled. It's unreliable and may contain garbage. Do not use it for any kind of security monitoring. 2024.12.16 12:08:02.319767 [ 12887 ] {} Context: Server has databases (for example `test_ip6kl7xs_3`) with Ordinary engine, which was deprecated. To convert this database to the new Atomic engine, create a flag /var/lib/clickhouse/flags/convert_ordinary_to_atomic and make sure that ClickHouse has write permission for it. Example: sudo touch '/var/lib/clickhouse/flags/convert_ordinary_to_atomic' && sudo chmod 666 '/var/lib/clickhouse/flags/convert_ordinary_to_atomic' 2024.12.16 12:08:02.858377 [ 13633 ] {} void DB::AsyncLoader::worker(Pool &): Code: 1. DB::Exception: Experimental WINDOW VIEW feature is not supported with new infrastructure for query analysis (the setting 'allow_experimental_analyzer'): Cannot attach table `test_1`.`wv` from metadata file /var/lib/clickhouse/store/a78/a7828c9b-5200-481c-ac66-4570598f91a1/wv.sql from query ATTACH WINDOW VIEW test_1.wv UUID 'a2de7aa9-7124-4016-995e-d12992706b6f' TO test_1.dst (`count` UInt64, `market` Int32, `w_end` DateTime('US/Samoa')) WATERMARK ASCENDING AS SELECT count(a) AS count, market, tumbleEnd(wid) AS w_end FROM test_1.mt GROUP BY tumble(timestamp, toIntervalSecond('5'), 'US/Samoa') AS wid, market. (UNSUPPORTED_METHOD), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f4eb7 6. /build/src/Storages/WindowView/StorageWindowView.cpp:1181: DB::StorageWindowView::StorageWindowView(DB::StorageID const&, std::shared_ptr, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel) @ 0x000000001d170c0d 7. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageWindowView* std::construct_at[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, DB::StorageWindowView*>(DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a5e3 8. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void, void>(std::allocator&, DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a361 9. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&>(std::allocator, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a02d 10. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, std::shared_ptr, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(std::allocator const&, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189e7a 11. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189e06 12. /build/src/Storages/WindowView/StorageWindowView.cpp:1693: DB::registerStorageWindowView(DB::StorageFactory&)::$_0::operator()(DB::StorageFactory::Arguments const&) const @ 0x000000001d17d7a6 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d17d61d 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001d17d5bd 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d17d57d 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d17d545 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001c3709de 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001c36f2fd 19. /build/src/Storages/StorageFactory.cpp:224: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, DB::LoadingStrictnessLevel) const @ 0x000000001c36dc1d 20. /build/src/Databases/DatabaseOnDisk.cpp:120: DB::createTableFromAST(DB::ASTCreateQuery, String const&, String const&, std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000001a0b0752 21. /build/src/Databases/DatabaseOrdinary.cpp:248: DB::DatabaseOrdinary::loadTableFromMetadata(std::shared_ptr, String const&, DB::QualifiedTableName const&, std::shared_ptr const&, DB::LoadingStrictnessLevel) @ 0x000000001a0d947b 22. /build/src/Databases/DatabaseOrdinary.cpp:283: DB::DatabaseOrdinary::loadTableFromMetadataAsync(DB::AsyncLoader&, std::unordered_set, std::hash>, std::equal_to>, std::allocator>>, std::shared_ptr, String const&, DB::QualifiedTableName const&, std::shared_ptr const&, DB::LoadingStrictnessLevel)::$_0::operator()(DB::AsyncLoader&, std::shared_ptr const&) const @ 0x000000001a0e0c63 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a0e0be5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a0e0ba5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a0e0b65 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a0e0b30 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000135ff446 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000135f5ac5 29. /build/src/Common/AsyncLoader.cpp:169: DB::LoadJob::execute(DB::AsyncLoader&, unsigned long, std::shared_ptr const&) @ 0x00000000135e790b 30. /build/src/Common/AsyncLoader.cpp:937: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f3f67 31. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock&)::$_1::operator()() const @ 0x00000000135f52dc (version 24.3.12.76.altinitystable) 2024.12.16 12:08:02.936127 [ 12887 ] {} Application: Caught exception while loading metadata: Code: 695. DB::Exception: Load job 'load table test_1.wv' failed: Code: 1. DB::Exception: Experimental WINDOW VIEW feature is not supported with new infrastructure for query analysis (the setting 'allow_experimental_analyzer'): Cannot attach table `test_1`.`wv` from metadata file /var/lib/clickhouse/store/a78/a7828c9b-5200-481c-ac66-4570598f91a1/wv.sql from query ATTACH WINDOW VIEW test_1.wv UUID 'a2de7aa9-7124-4016-995e-d12992706b6f' TO test_1.dst (`count` UInt64, `market` Int32, `w_end` DateTime('US/Samoa')) WATERMARK ASCENDING AS SELECT count(a) AS count, market, tumbleEnd(wid) AS w_end FROM test_1.mt GROUP BY tumble(timestamp, toIntervalSecond('5'), 'US/Samoa') AS wid, market. (UNSUPPORTED_METHOD), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f4eb7 6. /build/src/Storages/WindowView/StorageWindowView.cpp:1181: DB::StorageWindowView::StorageWindowView(DB::StorageID const&, std::shared_ptr, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel) @ 0x000000001d170c0d 7. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageWindowView* std::construct_at[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, DB::StorageWindowView*>(DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a5e3 8. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void, void>(std::allocator&, DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a361 9. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&>(std::allocator, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a02d 10. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, std::shared_ptr, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(std::allocator const&, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189e7a 11. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189e06 12. /build/src/Storages/WindowView/StorageWindowView.cpp:1693: DB::registerStorageWindowView(DB::StorageFactory&)::$_0::operator()(DB::StorageFactory::Arguments const&) const @ 0x000000001d17d7a6 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d17d61d 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001d17d5bd 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d17d57d 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d17d545 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001c3709de 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001c36f2fd 19. /build/src/Storages/StorageFactory.cpp:224: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, DB::LoadingStrictnessLevel) const @ 0x000000001c36dc1d 20. /build/src/Databases/DatabaseOnDisk.cpp:120: DB::createTableFromAST(DB::ASTCreateQuery, String const&, String const&, std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000001a0b0752 21. /build/src/Databases/DatabaseOrdinary.cpp:248: DB::DatabaseOrdinary::loadTableFromMetadata(std::shared_ptr, String const&, DB::QualifiedTableName const&, std::shared_ptr const&, DB::LoadingStrictnessLevel) @ 0x000000001a0d947b 22. /build/src/Databases/DatabaseOrdinary.cpp:283: DB::DatabaseOrdinary::loadTableFromMetadataAsync(DB::AsyncLoader&, std::unordered_set, std::hash>, std::equal_to>, std::allocator>>, std::shared_ptr, String const&, DB::QualifiedTableName const&, std::shared_ptr const&, DB::LoadingStrictnessLevel)::$_0::operator()(DB::AsyncLoader&, std::shared_ptr const&) const @ 0x000000001a0e0c63 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a0e0be5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a0e0ba5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a0e0b65 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a0e0b30 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000135ff446 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000135f5ac5 29. /build/src/Common/AsyncLoader.cpp:169: DB::LoadJob::execute(DB::AsyncLoader&, unsigned long, std::shared_ptr const&) @ 0x00000000135e790b 30. /build/src/Common/AsyncLoader.cpp:937: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f3f67 31. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock&)::$_1::operator()() const @ 0x00000000135f52dc (version 24.3.12.76.altinitystable). (ASYNC_LOAD_FAILED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String const&, String&&) @ 0x000000000b4fe4cc 6. /build/src/Common/AsyncLoader.cpp:942: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f415d 7. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock&)::$_1::operator()() const @ 0x00000000135f52dc 8. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000135f52b5 9. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000135f5295 10. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000135f5275 11. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000135f523d 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 14. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 15. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 17. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 18. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 19. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 20. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 26. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 27. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 29. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 30. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 31. ? @ 0x00007fe73653bac3 (version 24.3.12.76.altinitystable) 2024.12.16 12:08:08.860196 [ 13535 ] {} RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled 2024.12.16 12:08:09.462444 [ 12887 ] {} Application: Code: 695. DB::Exception: Load job 'load table test_1.wv' failed: Code: 1. DB::Exception: Experimental WINDOW VIEW feature is not supported with new infrastructure for query analysis (the setting 'allow_experimental_analyzer'): Cannot attach table `test_1`.`wv` from metadata file /var/lib/clickhouse/store/a78/a7828c9b-5200-481c-ac66-4570598f91a1/wv.sql from query ATTACH WINDOW VIEW test_1.wv UUID 'a2de7aa9-7124-4016-995e-d12992706b6f' TO test_1.dst (`count` UInt64, `market` Int32, `w_end` DateTime('US/Samoa')) WATERMARK ASCENDING AS SELECT count(a) AS count, market, tumbleEnd(wid) AS w_end FROM test_1.mt GROUP BY tumble(timestamp, toIntervalSecond('5'), 'US/Samoa') AS wid, market. (UNSUPPORTED_METHOD), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f4eb7 6. /build/src/Storages/WindowView/StorageWindowView.cpp:1181: DB::StorageWindowView::StorageWindowView(DB::StorageID const&, std::shared_ptr, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel) @ 0x000000001d170c0d 7. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageWindowView* std::construct_at[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, DB::StorageWindowView*>(DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a5e3 8. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void, void>(std::allocator&, DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a361 9. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&>(std::allocator, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a02d 10. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, std::shared_ptr, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(std::allocator const&, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189e7a 11. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189e06 12. /build/src/Storages/WindowView/StorageWindowView.cpp:1693: DB::registerStorageWindowView(DB::StorageFactory&)::$_0::operator()(DB::StorageFactory::Arguments const&) const @ 0x000000001d17d7a6 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d17d61d 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001d17d5bd 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d17d57d 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d17d545 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001c3709de 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001c36f2fd 19. /build/src/Storages/StorageFactory.cpp:224: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, DB::LoadingStrictnessLevel) const @ 0x000000001c36dc1d 20. /build/src/Databases/DatabaseOnDisk.cpp:120: DB::createTableFromAST(DB::ASTCreateQuery, String const&, String const&, std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000001a0b0752 21. /build/src/Databases/DatabaseOrdinary.cpp:248: DB::DatabaseOrdinary::loadTableFromMetadata(std::shared_ptr, String const&, DB::QualifiedTableName const&, std::shared_ptr const&, DB::LoadingStrictnessLevel) @ 0x000000001a0d947b 22. /build/src/Databases/DatabaseOrdinary.cpp:283: DB::DatabaseOrdinary::loadTableFromMetadataAsync(DB::AsyncLoader&, std::unordered_set, std::hash>, std::equal_to>, std::allocator>>, std::shared_ptr, String const&, DB::QualifiedTableName const&, std::shared_ptr const&, DB::LoadingStrictnessLevel)::$_0::operator()(DB::AsyncLoader&, std::shared_ptr const&) const @ 0x000000001a0e0c63 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a0e0be5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a0e0ba5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a0e0b65 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a0e0b30 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000135ff446 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000135f5ac5 29. /build/src/Common/AsyncLoader.cpp:169: DB::LoadJob::execute(DB::AsyncLoader&, unsigned long, std::shared_ptr const&) @ 0x00000000135e790b 30. /build/src/Common/AsyncLoader.cpp:937: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f3f67 31. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock&)::$_1::operator()() const @ 0x00000000135f52dc (version 24.3.12.76.altinitystable). (ASYNC_LOAD_FAILED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String const&, String&&) @ 0x000000000b4fe4cc 6. /build/src/Common/AsyncLoader.cpp:942: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f415d 7. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock&)::$_1::operator()() const @ 0x00000000135f52dc 8. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000135f52b5 9. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000135f5295 10. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000135f5275 11. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000135f523d 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 14. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 15. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 17. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 18. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 19. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 20. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 26. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 27. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 29. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 30. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 31. ? @ 0x00007fe73653bac3 (version 24.3.12.76.altinitystable) 2024.12.16 12:08:10.923167 [ 13719 ] {} Context: Server was built in debug mode. It will work slowly. 2024.12.16 12:08:10.954104 [ 13719 ] {} Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production. 2024.12.16 12:08:10.955483 [ 13719 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2024.12.16 12:08:10.958184 [ 13719 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2024.12.16 12:08:10.958329 [ 13719 ] {} Application: Integrity check of the executable skipped because the reference checksum could not be read. 2024.12.16 12:08:13.433658 [ 13719 ] {} CloudPlacementInfo: Placement info has not been loaded 2024.12.16 12:08:13.887937 [ 13719 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2024.12.16 12:08:13.895078 [ 13719 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2024.12.16 12:08:13.895207 [ 13719 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2024.12.16 12:08:13.947039 [ 14364 ] {} RaftInstance: Election timeout, initiate leader election 2024.12.16 12:08:16.371664 [ 13719 ] {} Context: Table system.session_log is enabled. It's unreliable and may contain garbage. Do not use it for any kind of security monitoring. 2024.12.16 12:08:16.902402 [ 13719 ] {} Context: Server has databases (for example `test_ip6kl7xs_3`) with Ordinary engine, which was deprecated. To convert this database to the new Atomic engine, create a flag /var/lib/clickhouse/flags/convert_ordinary_to_atomic and make sure that ClickHouse has write permission for it. Example: sudo touch '/var/lib/clickhouse/flags/convert_ordinary_to_atomic' && sudo chmod 666 '/var/lib/clickhouse/flags/convert_ordinary_to_atomic' 2024.12.16 12:08:17.474308 [ 14495 ] {} void DB::AsyncLoader::worker(Pool &): Code: 1. DB::Exception: Experimental WINDOW VIEW feature is not supported with new infrastructure for query analysis (the setting 'allow_experimental_analyzer'): Cannot attach table `test_1`.`wv` from metadata file /var/lib/clickhouse/store/a78/a7828c9b-5200-481c-ac66-4570598f91a1/wv.sql from query ATTACH WINDOW VIEW test_1.wv UUID 'a2de7aa9-7124-4016-995e-d12992706b6f' TO test_1.dst (`count` UInt64, `market` Int32, `w_end` DateTime('US/Samoa')) WATERMARK ASCENDING AS SELECT count(a) AS count, market, tumbleEnd(wid) AS w_end FROM test_1.mt GROUP BY tumble(timestamp, toIntervalSecond('5'), 'US/Samoa') AS wid, market. (UNSUPPORTED_METHOD), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f4eb7 6. /build/src/Storages/WindowView/StorageWindowView.cpp:1181: DB::StorageWindowView::StorageWindowView(DB::StorageID const&, std::shared_ptr, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel) @ 0x000000001d170c0d 7. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageWindowView* std::construct_at[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, DB::StorageWindowView*>(DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a5e3 8. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void, void>(std::allocator&, DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a361 9. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&>(std::allocator, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a02d 10. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, std::shared_ptr, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(std::allocator const&, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189e7a 11. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189e06 12. /build/src/Storages/WindowView/StorageWindowView.cpp:1693: DB::registerStorageWindowView(DB::StorageFactory&)::$_0::operator()(DB::StorageFactory::Arguments const&) const @ 0x000000001d17d7a6 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d17d61d 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001d17d5bd 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d17d57d 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d17d545 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001c3709de 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001c36f2fd 19. /build/src/Storages/StorageFactory.cpp:224: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, DB::LoadingStrictnessLevel) const @ 0x000000001c36dc1d 20. /build/src/Databases/DatabaseOnDisk.cpp:120: DB::createTableFromAST(DB::ASTCreateQuery, String const&, String const&, std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000001a0b0752 21. /build/src/Databases/DatabaseOrdinary.cpp:248: DB::DatabaseOrdinary::loadTableFromMetadata(std::shared_ptr, String const&, DB::QualifiedTableName const&, std::shared_ptr const&, DB::LoadingStrictnessLevel) @ 0x000000001a0d947b 22. /build/src/Databases/DatabaseOrdinary.cpp:283: DB::DatabaseOrdinary::loadTableFromMetadataAsync(DB::AsyncLoader&, std::unordered_set, std::hash>, std::equal_to>, std::allocator>>, std::shared_ptr, String const&, DB::QualifiedTableName const&, std::shared_ptr const&, DB::LoadingStrictnessLevel)::$_0::operator()(DB::AsyncLoader&, std::shared_ptr const&) const @ 0x000000001a0e0c63 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a0e0be5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a0e0ba5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a0e0b65 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a0e0b30 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000135ff446 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000135f5ac5 29. /build/src/Common/AsyncLoader.cpp:169: DB::LoadJob::execute(DB::AsyncLoader&, unsigned long, std::shared_ptr const&) @ 0x00000000135e790b 30. /build/src/Common/AsyncLoader.cpp:937: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f3f67 31. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock&)::$_1::operator()() const @ 0x00000000135f52dc (version 24.3.12.76.altinitystable) 2024.12.16 12:08:17.730885 [ 13719 ] {} Application: Caught exception while loading metadata: Code: 695. DB::Exception: Load job 'load table test_1.wv' failed: Code: 1. DB::Exception: Experimental WINDOW VIEW feature is not supported with new infrastructure for query analysis (the setting 'allow_experimental_analyzer'): Cannot attach table `test_1`.`wv` from metadata file /var/lib/clickhouse/store/a78/a7828c9b-5200-481c-ac66-4570598f91a1/wv.sql from query ATTACH WINDOW VIEW test_1.wv UUID 'a2de7aa9-7124-4016-995e-d12992706b6f' TO test_1.dst (`count` UInt64, `market` Int32, `w_end` DateTime('US/Samoa')) WATERMARK ASCENDING AS SELECT count(a) AS count, market, tumbleEnd(wid) AS w_end FROM test_1.mt GROUP BY tumble(timestamp, toIntervalSecond('5'), 'US/Samoa') AS wid, market. (UNSUPPORTED_METHOD), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f4eb7 6. /build/src/Storages/WindowView/StorageWindowView.cpp:1181: DB::StorageWindowView::StorageWindowView(DB::StorageID const&, std::shared_ptr, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel) @ 0x000000001d170c0d 7. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageWindowView* std::construct_at[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, DB::StorageWindowView*>(DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a5e3 8. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void, void>(std::allocator&, DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a361 9. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&>(std::allocator, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a02d 10. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, std::shared_ptr, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(std::allocator const&, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189e7a 11. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189e06 12. /build/src/Storages/WindowView/StorageWindowView.cpp:1693: DB::registerStorageWindowView(DB::StorageFactory&)::$_0::operator()(DB::StorageFactory::Arguments const&) const @ 0x000000001d17d7a6 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d17d61d 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001d17d5bd 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d17d57d 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d17d545 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001c3709de 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001c36f2fd 19. /build/src/Storages/StorageFactory.cpp:224: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, DB::LoadingStrictnessLevel) const @ 0x000000001c36dc1d 20. /build/src/Databases/DatabaseOnDisk.cpp:120: DB::createTableFromAST(DB::ASTCreateQuery, String const&, String const&, std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000001a0b0752 21. /build/src/Databases/DatabaseOrdinary.cpp:248: DB::DatabaseOrdinary::loadTableFromMetadata(std::shared_ptr, String const&, DB::QualifiedTableName const&, std::shared_ptr const&, DB::LoadingStrictnessLevel) @ 0x000000001a0d947b 22. /build/src/Databases/DatabaseOrdinary.cpp:283: DB::DatabaseOrdinary::loadTableFromMetadataAsync(DB::AsyncLoader&, std::unordered_set, std::hash>, std::equal_to>, std::allocator>>, std::shared_ptr, String const&, DB::QualifiedTableName const&, std::shared_ptr const&, DB::LoadingStrictnessLevel)::$_0::operator()(DB::AsyncLoader&, std::shared_ptr const&) const @ 0x000000001a0e0c63 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a0e0be5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a0e0ba5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a0e0b65 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a0e0b30 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000135ff446 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000135f5ac5 29. /build/src/Common/AsyncLoader.cpp:169: DB::LoadJob::execute(DB::AsyncLoader&, unsigned long, std::shared_ptr const&) @ 0x00000000135e790b 30. /build/src/Common/AsyncLoader.cpp:937: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f3f67 31. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock&)::$_1::operator()() const @ 0x00000000135f52dc (version 24.3.12.76.altinitystable). (ASYNC_LOAD_FAILED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String const&, String&&) @ 0x000000000b4fe4cc 6. /build/src/Common/AsyncLoader.cpp:942: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f415d 7. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock&)::$_1::operator()() const @ 0x00000000135f52dc 8. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000135f52b5 9. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000135f5295 10. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000135f5275 11. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000135f523d 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 14. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 15. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 17. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 18. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 19. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 20. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 26. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 27. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 29. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 30. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 31. ? @ 0x00007feb9879eac3 (version 24.3.12.76.altinitystable) 2024.12.16 12:08:22.970481 [ 14367 ] {} RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled 2024.12.16 12:08:23.489643 [ 13719 ] {} Application: Code: 695. DB::Exception: Load job 'load table test_1.wv' failed: Code: 1. DB::Exception: Experimental WINDOW VIEW feature is not supported with new infrastructure for query analysis (the setting 'allow_experimental_analyzer'): Cannot attach table `test_1`.`wv` from metadata file /var/lib/clickhouse/store/a78/a7828c9b-5200-481c-ac66-4570598f91a1/wv.sql from query ATTACH WINDOW VIEW test_1.wv UUID 'a2de7aa9-7124-4016-995e-d12992706b6f' TO test_1.dst (`count` UInt64, `market` Int32, `w_end` DateTime('US/Samoa')) WATERMARK ASCENDING AS SELECT count(a) AS count, market, tumbleEnd(wid) AS w_end FROM test_1.mt GROUP BY tumble(timestamp, toIntervalSecond('5'), 'US/Samoa') AS wid, market. (UNSUPPORTED_METHOD), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f4eb7 6. /build/src/Storages/WindowView/StorageWindowView.cpp:1181: DB::StorageWindowView::StorageWindowView(DB::StorageID const&, std::shared_ptr, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel) @ 0x000000001d170c0d 7. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageWindowView* std::construct_at[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, DB::StorageWindowView*>(DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a5e3 8. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void, void>(std::allocator&, DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a361 9. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&>(std::allocator, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a02d 10. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, std::shared_ptr, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(std::allocator const&, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189e7a 11. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189e06 12. /build/src/Storages/WindowView/StorageWindowView.cpp:1693: DB::registerStorageWindowView(DB::StorageFactory&)::$_0::operator()(DB::StorageFactory::Arguments const&) const @ 0x000000001d17d7a6 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d17d61d 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001d17d5bd 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d17d57d 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d17d545 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001c3709de 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001c36f2fd 19. /build/src/Storages/StorageFactory.cpp:224: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, DB::LoadingStrictnessLevel) const @ 0x000000001c36dc1d 20. /build/src/Databases/DatabaseOnDisk.cpp:120: DB::createTableFromAST(DB::ASTCreateQuery, String const&, String const&, std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000001a0b0752 21. /build/src/Databases/DatabaseOrdinary.cpp:248: DB::DatabaseOrdinary::loadTableFromMetadata(std::shared_ptr, String const&, DB::QualifiedTableName const&, std::shared_ptr const&, DB::LoadingStrictnessLevel) @ 0x000000001a0d947b 22. /build/src/Databases/DatabaseOrdinary.cpp:283: DB::DatabaseOrdinary::loadTableFromMetadataAsync(DB::AsyncLoader&, std::unordered_set, std::hash>, std::equal_to>, std::allocator>>, std::shared_ptr, String const&, DB::QualifiedTableName const&, std::shared_ptr const&, DB::LoadingStrictnessLevel)::$_0::operator()(DB::AsyncLoader&, std::shared_ptr const&) const @ 0x000000001a0e0c63 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a0e0be5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a0e0ba5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a0e0b65 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a0e0b30 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000135ff446 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000135f5ac5 29. /build/src/Common/AsyncLoader.cpp:169: DB::LoadJob::execute(DB::AsyncLoader&, unsigned long, std::shared_ptr const&) @ 0x00000000135e790b 30. /build/src/Common/AsyncLoader.cpp:937: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f3f67 31. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock&)::$_1::operator()() const @ 0x00000000135f52dc (version 24.3.12.76.altinitystable). (ASYNC_LOAD_FAILED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String const&, String&&) @ 0x000000000b4fe4cc 6. /build/src/Common/AsyncLoader.cpp:942: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f415d 7. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock&)::$_1::operator()() const @ 0x00000000135f52dc 8. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000135f52b5 9. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000135f5295 10. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000135f5275 11. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000135f523d 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 14. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 15. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 17. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 18. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 19. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 20. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 26. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 27. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 29. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 30. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 31. ? @ 0x00007feb9879eac3 (version 24.3.12.76.altinitystable) 2024.12.16 12:08:25.607540 [ 14558 ] {} Context: Server was built in debug mode. It will work slowly. 2024.12.16 12:08:25.639050 [ 14558 ] {} Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production. 2024.12.16 12:08:25.640292 [ 14558 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2024.12.16 12:08:25.643001 [ 14558 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2024.12.16 12:08:25.643157 [ 14558 ] {} Application: Integrity check of the executable skipped because the reference checksum could not be read. 2024.12.16 12:08:28.166838 [ 14558 ] {} CloudPlacementInfo: Placement info has not been loaded 2024.12.16 12:08:28.590735 [ 14558 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2024.12.16 12:08:28.596553 [ 14558 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2024.12.16 12:08:28.596655 [ 14558 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2024.12.16 12:08:28.648339 [ 15203 ] {} RaftInstance: Election timeout, initiate leader election 2024.12.16 12:08:31.080353 [ 14558 ] {} Context: Table system.session_log is enabled. It's unreliable and may contain garbage. Do not use it for any kind of security monitoring. 2024.12.16 12:08:31.610034 [ 14558 ] {} Context: Server has databases (for example `test_ip6kl7xs_3`) with Ordinary engine, which was deprecated. To convert this database to the new Atomic engine, create a flag /var/lib/clickhouse/flags/convert_ordinary_to_atomic and make sure that ClickHouse has write permission for it. Example: sudo touch '/var/lib/clickhouse/flags/convert_ordinary_to_atomic' && sudo chmod 666 '/var/lib/clickhouse/flags/convert_ordinary_to_atomic' 2024.12.16 12:08:32.109768 [ 15329 ] {} void DB::AsyncLoader::worker(Pool &): Code: 1. DB::Exception: Experimental WINDOW VIEW feature is not supported with new infrastructure for query analysis (the setting 'allow_experimental_analyzer'): Cannot attach table `test_1`.`wv` from metadata file /var/lib/clickhouse/store/a78/a7828c9b-5200-481c-ac66-4570598f91a1/wv.sql from query ATTACH WINDOW VIEW test_1.wv UUID 'a2de7aa9-7124-4016-995e-d12992706b6f' TO test_1.dst (`count` UInt64, `market` Int32, `w_end` DateTime('US/Samoa')) WATERMARK ASCENDING AS SELECT count(a) AS count, market, tumbleEnd(wid) AS w_end FROM test_1.mt GROUP BY tumble(timestamp, toIntervalSecond('5'), 'US/Samoa') AS wid, market. (UNSUPPORTED_METHOD), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f4eb7 6. /build/src/Storages/WindowView/StorageWindowView.cpp:1181: DB::StorageWindowView::StorageWindowView(DB::StorageID const&, std::shared_ptr, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel) @ 0x000000001d170c0d 7. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageWindowView* std::construct_at[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, DB::StorageWindowView*>(DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a5e3 8. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void, void>(std::allocator&, DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a361 9. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&>(std::allocator, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a02d 10. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, std::shared_ptr, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(std::allocator const&, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189e7a 11. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189e06 12. /build/src/Storages/WindowView/StorageWindowView.cpp:1693: DB::registerStorageWindowView(DB::StorageFactory&)::$_0::operator()(DB::StorageFactory::Arguments const&) const @ 0x000000001d17d7a6 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d17d61d 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001d17d5bd 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d17d57d 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d17d545 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001c3709de 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001c36f2fd 19. /build/src/Storages/StorageFactory.cpp:224: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, DB::LoadingStrictnessLevel) const @ 0x000000001c36dc1d 20. /build/src/Databases/DatabaseOnDisk.cpp:120: DB::createTableFromAST(DB::ASTCreateQuery, String const&, String const&, std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000001a0b0752 21. /build/src/Databases/DatabaseOrdinary.cpp:248: DB::DatabaseOrdinary::loadTableFromMetadata(std::shared_ptr, String const&, DB::QualifiedTableName const&, std::shared_ptr const&, DB::LoadingStrictnessLevel) @ 0x000000001a0d947b 22. /build/src/Databases/DatabaseOrdinary.cpp:283: DB::DatabaseOrdinary::loadTableFromMetadataAsync(DB::AsyncLoader&, std::unordered_set, std::hash>, std::equal_to>, std::allocator>>, std::shared_ptr, String const&, DB::QualifiedTableName const&, std::shared_ptr const&, DB::LoadingStrictnessLevel)::$_0::operator()(DB::AsyncLoader&, std::shared_ptr const&) const @ 0x000000001a0e0c63 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a0e0be5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a0e0ba5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a0e0b65 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a0e0b30 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000135ff446 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000135f5ac5 29. /build/src/Common/AsyncLoader.cpp:169: DB::LoadJob::execute(DB::AsyncLoader&, unsigned long, std::shared_ptr const&) @ 0x00000000135e790b 30. /build/src/Common/AsyncLoader.cpp:937: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f3f67 31. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock&)::$_1::operator()() const @ 0x00000000135f52dc (version 24.3.12.76.altinitystable) 2024.12.16 12:08:32.168523 [ 14558 ] {} Application: Caught exception while loading metadata: Code: 695. DB::Exception: Load job 'load table test_1.wv' failed: Code: 1. DB::Exception: Experimental WINDOW VIEW feature is not supported with new infrastructure for query analysis (the setting 'allow_experimental_analyzer'): Cannot attach table `test_1`.`wv` from metadata file /var/lib/clickhouse/store/a78/a7828c9b-5200-481c-ac66-4570598f91a1/wv.sql from query ATTACH WINDOW VIEW test_1.wv UUID 'a2de7aa9-7124-4016-995e-d12992706b6f' TO test_1.dst (`count` UInt64, `market` Int32, `w_end` DateTime('US/Samoa')) WATERMARK ASCENDING AS SELECT count(a) AS count, market, tumbleEnd(wid) AS w_end FROM test_1.mt GROUP BY tumble(timestamp, toIntervalSecond('5'), 'US/Samoa') AS wid, market. (UNSUPPORTED_METHOD), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f4eb7 6. /build/src/Storages/WindowView/StorageWindowView.cpp:1181: DB::StorageWindowView::StorageWindowView(DB::StorageID const&, std::shared_ptr, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel) @ 0x000000001d170c0d 7. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageWindowView* std::construct_at[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, DB::StorageWindowView*>(DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a5e3 8. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void, void>(std::allocator&, DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a361 9. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&>(std::allocator, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a02d 10. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, std::shared_ptr, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(std::allocator const&, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189e7a 11. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189e06 12. /build/src/Storages/WindowView/StorageWindowView.cpp:1693: DB::registerStorageWindowView(DB::StorageFactory&)::$_0::operator()(DB::StorageFactory::Arguments const&) const @ 0x000000001d17d7a6 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d17d61d 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001d17d5bd 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d17d57d 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d17d545 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001c3709de 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001c36f2fd 19. /build/src/Storages/StorageFactory.cpp:224: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, DB::LoadingStrictnessLevel) const @ 0x000000001c36dc1d 20. /build/src/Databases/DatabaseOnDisk.cpp:120: DB::createTableFromAST(DB::ASTCreateQuery, String const&, String const&, std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000001a0b0752 21. /build/src/Databases/DatabaseOrdinary.cpp:248: DB::DatabaseOrdinary::loadTableFromMetadata(std::shared_ptr, String const&, DB::QualifiedTableName const&, std::shared_ptr const&, DB::LoadingStrictnessLevel) @ 0x000000001a0d947b 22. /build/src/Databases/DatabaseOrdinary.cpp:283: DB::DatabaseOrdinary::loadTableFromMetadataAsync(DB::AsyncLoader&, std::unordered_set, std::hash>, std::equal_to>, std::allocator>>, std::shared_ptr, String const&, DB::QualifiedTableName const&, std::shared_ptr const&, DB::LoadingStrictnessLevel)::$_0::operator()(DB::AsyncLoader&, std::shared_ptr const&) const @ 0x000000001a0e0c63 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a0e0be5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a0e0ba5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a0e0b65 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a0e0b30 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000135ff446 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000135f5ac5 29. /build/src/Common/AsyncLoader.cpp:169: DB::LoadJob::execute(DB::AsyncLoader&, unsigned long, std::shared_ptr const&) @ 0x00000000135e790b 30. /build/src/Common/AsyncLoader.cpp:937: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f3f67 31. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock&)::$_1::operator()() const @ 0x00000000135f52dc (version 24.3.12.76.altinitystable). (ASYNC_LOAD_FAILED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String const&, String&&) @ 0x000000000b4fe4cc 6. /build/src/Common/AsyncLoader.cpp:942: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f415d 7. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock&)::$_1::operator()() const @ 0x00000000135f52dc 8. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000135f52b5 9. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000135f5295 10. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000135f5275 11. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000135f523d 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 14. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 15. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 17. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 18. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 19. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 20. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 26. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 27. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 29. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 30. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 31. ? @ 0x00007fe321741ac3 (version 24.3.12.76.altinitystable) 2024.12.16 12:08:38.673151 [ 15206 ] {} RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled 2024.12.16 12:08:39.207771 [ 14558 ] {} Application: Code: 695. DB::Exception: Load job 'load table test_1.wv' failed: Code: 1. DB::Exception: Experimental WINDOW VIEW feature is not supported with new infrastructure for query analysis (the setting 'allow_experimental_analyzer'): Cannot attach table `test_1`.`wv` from metadata file /var/lib/clickhouse/store/a78/a7828c9b-5200-481c-ac66-4570598f91a1/wv.sql from query ATTACH WINDOW VIEW test_1.wv UUID 'a2de7aa9-7124-4016-995e-d12992706b6f' TO test_1.dst (`count` UInt64, `market` Int32, `w_end` DateTime('US/Samoa')) WATERMARK ASCENDING AS SELECT count(a) AS count, market, tumbleEnd(wid) AS w_end FROM test_1.mt GROUP BY tumble(timestamp, toIntervalSecond('5'), 'US/Samoa') AS wid, market. (UNSUPPORTED_METHOD), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f4eb7 6. /build/src/Storages/WindowView/StorageWindowView.cpp:1181: DB::StorageWindowView::StorageWindowView(DB::StorageID const&, std::shared_ptr, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel) @ 0x000000001d170c0d 7. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageWindowView* std::construct_at[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, DB::StorageWindowView*>(DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a5e3 8. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void, void>(std::allocator&, DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a361 9. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&>(std::allocator, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a02d 10. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, std::shared_ptr, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(std::allocator const&, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189e7a 11. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189e06 12. /build/src/Storages/WindowView/StorageWindowView.cpp:1693: DB::registerStorageWindowView(DB::StorageFactory&)::$_0::operator()(DB::StorageFactory::Arguments const&) const @ 0x000000001d17d7a6 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d17d61d 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001d17d5bd 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d17d57d 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d17d545 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001c3709de 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001c36f2fd 19. /build/src/Storages/StorageFactory.cpp:224: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, DB::LoadingStrictnessLevel) const @ 0x000000001c36dc1d 20. /build/src/Databases/DatabaseOnDisk.cpp:120: DB::createTableFromAST(DB::ASTCreateQuery, String const&, String const&, std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000001a0b0752 21. /build/src/Databases/DatabaseOrdinary.cpp:248: DB::DatabaseOrdinary::loadTableFromMetadata(std::shared_ptr, String const&, DB::QualifiedTableName const&, std::shared_ptr const&, DB::LoadingStrictnessLevel) @ 0x000000001a0d947b 22. /build/src/Databases/DatabaseOrdinary.cpp:283: DB::DatabaseOrdinary::loadTableFromMetadataAsync(DB::AsyncLoader&, std::unordered_set, std::hash>, std::equal_to>, std::allocator>>, std::shared_ptr, String const&, DB::QualifiedTableName const&, std::shared_ptr const&, DB::LoadingStrictnessLevel)::$_0::operator()(DB::AsyncLoader&, std::shared_ptr const&) const @ 0x000000001a0e0c63 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a0e0be5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a0e0ba5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a0e0b65 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a0e0b30 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000135ff446 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000135f5ac5 29. /build/src/Common/AsyncLoader.cpp:169: DB::LoadJob::execute(DB::AsyncLoader&, unsigned long, std::shared_ptr const&) @ 0x00000000135e790b 30. /build/src/Common/AsyncLoader.cpp:937: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f3f67 31. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock&)::$_1::operator()() const @ 0x00000000135f52dc (version 24.3.12.76.altinitystable). (ASYNC_LOAD_FAILED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String const&, String&&) @ 0x000000000b4fe4cc 6. /build/src/Common/AsyncLoader.cpp:942: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f415d 7. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock&)::$_1::operator()() const @ 0x00000000135f52dc 8. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000135f52b5 9. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000135f5295 10. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000135f5275 11. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000135f523d 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 14. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 15. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 17. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 18. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 19. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 20. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 26. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 27. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 29. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 30. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 31. ? @ 0x00007fe321741ac3 (version 24.3.12.76.altinitystable) 2024.12.16 12:08:40.490187 [ 15389 ] {} Context: Server was built in debug mode. It will work slowly. 2024.12.16 12:08:40.521264 [ 15389 ] {} Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production. 2024.12.16 12:08:40.523035 [ 15389 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2024.12.16 12:08:40.525922 [ 15389 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2024.12.16 12:08:40.526087 [ 15389 ] {} Application: Integrity check of the executable skipped because the reference checksum could not be read. 2024.12.16 12:08:43.054393 [ 15389 ] {} CloudPlacementInfo: Placement info has not been loaded 2024.12.16 12:08:43.501735 [ 15389 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2024.12.16 12:08:43.507356 [ 15389 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2024.12.16 12:08:43.507451 [ 15389 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2024.12.16 12:08:43.558908 [ 16034 ] {} RaftInstance: Election timeout, initiate leader election 2024.12.16 12:08:45.962237 [ 15389 ] {} Context: Table system.session_log is enabled. It's unreliable and may contain garbage. Do not use it for any kind of security monitoring. 2024.12.16 12:08:46.538376 [ 15389 ] {} Context: Server has databases (for example `test_ip6kl7xs_3`) with Ordinary engine, which was deprecated. To convert this database to the new Atomic engine, create a flag /var/lib/clickhouse/flags/convert_ordinary_to_atomic and make sure that ClickHouse has write permission for it. Example: sudo touch '/var/lib/clickhouse/flags/convert_ordinary_to_atomic' && sudo chmod 666 '/var/lib/clickhouse/flags/convert_ordinary_to_atomic' 2024.12.16 12:08:47.054783 [ 16182 ] {} void DB::AsyncLoader::worker(Pool &): Code: 1. DB::Exception: Experimental WINDOW VIEW feature is not supported with new infrastructure for query analysis (the setting 'allow_experimental_analyzer'): Cannot attach table `test_1`.`wv` from metadata file /var/lib/clickhouse/store/a78/a7828c9b-5200-481c-ac66-4570598f91a1/wv.sql from query ATTACH WINDOW VIEW test_1.wv UUID 'a2de7aa9-7124-4016-995e-d12992706b6f' TO test_1.dst (`count` UInt64, `market` Int32, `w_end` DateTime('US/Samoa')) WATERMARK ASCENDING AS SELECT count(a) AS count, market, tumbleEnd(wid) AS w_end FROM test_1.mt GROUP BY tumble(timestamp, toIntervalSecond('5'), 'US/Samoa') AS wid, market. (UNSUPPORTED_METHOD), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f4eb7 6. /build/src/Storages/WindowView/StorageWindowView.cpp:1181: DB::StorageWindowView::StorageWindowView(DB::StorageID const&, std::shared_ptr, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel) @ 0x000000001d170c0d 7. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageWindowView* std::construct_at[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, DB::StorageWindowView*>(DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a5e3 8. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void, void>(std::allocator&, DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a361 9. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&>(std::allocator, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a02d 10. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, std::shared_ptr, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(std::allocator const&, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189e7a 11. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189e06 12. /build/src/Storages/WindowView/StorageWindowView.cpp:1693: DB::registerStorageWindowView(DB::StorageFactory&)::$_0::operator()(DB::StorageFactory::Arguments const&) const @ 0x000000001d17d7a6 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d17d61d 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001d17d5bd 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d17d57d 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d17d545 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001c3709de 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001c36f2fd 19. /build/src/Storages/StorageFactory.cpp:224: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, DB::LoadingStrictnessLevel) const @ 0x000000001c36dc1d 20. /build/src/Databases/DatabaseOnDisk.cpp:120: DB::createTableFromAST(DB::ASTCreateQuery, String const&, String const&, std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000001a0b0752 21. /build/src/Databases/DatabaseOrdinary.cpp:248: DB::DatabaseOrdinary::loadTableFromMetadata(std::shared_ptr, String const&, DB::QualifiedTableName const&, std::shared_ptr const&, DB::LoadingStrictnessLevel) @ 0x000000001a0d947b 22. /build/src/Databases/DatabaseOrdinary.cpp:283: DB::DatabaseOrdinary::loadTableFromMetadataAsync(DB::AsyncLoader&, std::unordered_set, std::hash>, std::equal_to>, std::allocator>>, std::shared_ptr, String const&, DB::QualifiedTableName const&, std::shared_ptr const&, DB::LoadingStrictnessLevel)::$_0::operator()(DB::AsyncLoader&, std::shared_ptr const&) const @ 0x000000001a0e0c63 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a0e0be5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a0e0ba5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a0e0b65 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a0e0b30 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000135ff446 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000135f5ac5 29. /build/src/Common/AsyncLoader.cpp:169: DB::LoadJob::execute(DB::AsyncLoader&, unsigned long, std::shared_ptr const&) @ 0x00000000135e790b 30. /build/src/Common/AsyncLoader.cpp:937: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f3f67 31. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock&)::$_1::operator()() const @ 0x00000000135f52dc (version 24.3.12.76.altinitystable) 2024.12.16 12:08:47.187605 [ 15389 ] {} Application: Caught exception while loading metadata: Code: 695. DB::Exception: Load job 'load table test_1.wv' failed: Code: 1. DB::Exception: Experimental WINDOW VIEW feature is not supported with new infrastructure for query analysis (the setting 'allow_experimental_analyzer'): Cannot attach table `test_1`.`wv` from metadata file /var/lib/clickhouse/store/a78/a7828c9b-5200-481c-ac66-4570598f91a1/wv.sql from query ATTACH WINDOW VIEW test_1.wv UUID 'a2de7aa9-7124-4016-995e-d12992706b6f' TO test_1.dst (`count` UInt64, `market` Int32, `w_end` DateTime('US/Samoa')) WATERMARK ASCENDING AS SELECT count(a) AS count, market, tumbleEnd(wid) AS w_end FROM test_1.mt GROUP BY tumble(timestamp, toIntervalSecond('5'), 'US/Samoa') AS wid, market. (UNSUPPORTED_METHOD), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f4eb7 6. /build/src/Storages/WindowView/StorageWindowView.cpp:1181: DB::StorageWindowView::StorageWindowView(DB::StorageID const&, std::shared_ptr, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel) @ 0x000000001d170c0d 7. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageWindowView* std::construct_at[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, DB::StorageWindowView*>(DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a5e3 8. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void, void>(std::allocator&, DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a361 9. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&>(std::allocator, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a02d 10. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, std::shared_ptr, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(std::allocator const&, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189e7a 11. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189e06 12. /build/src/Storages/WindowView/StorageWindowView.cpp:1693: DB::registerStorageWindowView(DB::StorageFactory&)::$_0::operator()(DB::StorageFactory::Arguments const&) const @ 0x000000001d17d7a6 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d17d61d 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001d17d5bd 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d17d57d 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d17d545 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001c3709de 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001c36f2fd 19. /build/src/Storages/StorageFactory.cpp:224: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, DB::LoadingStrictnessLevel) const @ 0x000000001c36dc1d 20. /build/src/Databases/DatabaseOnDisk.cpp:120: DB::createTableFromAST(DB::ASTCreateQuery, String const&, String const&, std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000001a0b0752 21. /build/src/Databases/DatabaseOrdinary.cpp:248: DB::DatabaseOrdinary::loadTableFromMetadata(std::shared_ptr, String const&, DB::QualifiedTableName const&, std::shared_ptr const&, DB::LoadingStrictnessLevel) @ 0x000000001a0d947b 22. /build/src/Databases/DatabaseOrdinary.cpp:283: DB::DatabaseOrdinary::loadTableFromMetadataAsync(DB::AsyncLoader&, std::unordered_set, std::hash>, std::equal_to>, std::allocator>>, std::shared_ptr, String const&, DB::QualifiedTableName const&, std::shared_ptr const&, DB::LoadingStrictnessLevel)::$_0::operator()(DB::AsyncLoader&, std::shared_ptr const&) const @ 0x000000001a0e0c63 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a0e0be5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a0e0ba5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a0e0b65 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a0e0b30 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000135ff446 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000135f5ac5 29. /build/src/Common/AsyncLoader.cpp:169: DB::LoadJob::execute(DB::AsyncLoader&, unsigned long, std::shared_ptr const&) @ 0x00000000135e790b 30. /build/src/Common/AsyncLoader.cpp:937: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f3f67 31. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock&)::$_1::operator()() const @ 0x00000000135f52dc (version 24.3.12.76.altinitystable). (ASYNC_LOAD_FAILED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String const&, String&&) @ 0x000000000b4fe4cc 6. /build/src/Common/AsyncLoader.cpp:942: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f415d 7. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock&)::$_1::operator()() const @ 0x00000000135f52dc 8. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000135f52b5 9. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000135f5295 10. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000135f5275 11. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000135f523d 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 14. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 15. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 17. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 18. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 19. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 20. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 26. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 27. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 29. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 30. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 31. ? @ 0x00007f01847acac3 (version 24.3.12.76.altinitystable) 2024.12.16 12:10:20.641569 [ 16162 ] {} ZooKeeperClient: Code: 33. DB::Exception: Cannot read all data. Bytes read: 0. Bytes expected: 4. (CANNOT_READ_ALL_DATA), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, unsigned long&, String&&) @ 0x000000000afd304c 6. /build/src/IO/ReadBuffer.h:199: DB::ReadBuffer::readStrict(char*, unsigned long) @ 0x000000000afd2e6f 7. /build/src/IO/ReadHelpers.h:118: void DB::readPODBinary(int&, DB::ReadBuffer&) @ 0x00000000133868e2 8. /build/src/IO/ReadHelpers.h:1303: void DB::readBinary(int&, DB::ReadBuffer&) @ 0x000000001338689d 9. /build/src/IO/ReadHelpers.h:1340: void DB::readBinaryEndian<(std::endian)64206, int>(int&, DB::ReadBuffer&) @ 0x000000001d41cd3d 10. /build/src/IO/ReadHelpers.h:1353: void DB::readBinaryBigEndian(int&, DB::ReadBuffer&) @ 0x000000001d41ccfd 11. /build/src/Common/ZooKeeper/ZooKeeperIO.h:51: void Coordination::read(int&, DB::ReadBuffer&) @ 0x000000001d41743d 12. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:289: void Coordination::ZooKeeper::read(int&) @ 0x000000001e2523ed 13. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:807: Coordination::ZooKeeper::receiveEvent() @ 0x000000001e24778c 14. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:773: Coordination::ZooKeeper::receiveThread() @ 0x000000001e2471d9 15. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:398: Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_1::operator()() const @ 0x000000001e24d698 16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001e24d675 17. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_1&, std::tuple<>&>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_1&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e24d659 18. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_1&, std::tuple<>&>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_1&, std::tuple<>&) @ 0x000000001e24d5bd 19. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_1>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_1&&)::'lambda'()::operator()() @ 0x000000001e24d4e5 20. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001e24d455 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001e24d435 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001e24d415 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001e24d3e0 24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 26. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 27. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 29. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 30. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 31. ? @ 0x00007f01847acac3 (version 24.3.12.76.altinitystable) 2024.12.16 12:10:20.731246 [ 16155 ] {} ZooKeeperClient: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:57896 -> [::1]:9181). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x00000000134e9548 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:169: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000134e8a44 7. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a92aced 8. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:303: Coordination::ZooKeeper::flushWriteBuffer() @ 0x000000001e23d7fd 9. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:707: Coordination::ZooKeeper::sendThread() @ 0x000000001e246469 10. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:397: Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_0::operator()() const @ 0x000000001e24ce58 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001e24ce35 12. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_0&, std::tuple<>&>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e24ce19 13. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_0&, std::tuple<>&>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_0&, std::tuple<>&) @ 0x000000001e24cd7d 14. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_0>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_0&&)::'lambda'()::operator()() @ 0x000000001e24cca5 15. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001e24cc15 16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001e24cbf5 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001e24cbd5 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001e24cba0 19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 21. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 22. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 24. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 25. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 26. ? @ 0x00007f01847acac3 27. ? @ 0x00007f018483e850 (version 24.3.12.76.altinitystable) 2024.12.16 12:10:20.866747 [ 16162 ] {} ZooKeeperClient: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a09d07 4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0de47 5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022894827 6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a416b 7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x00000000228a2b09 8. /build/base/poco/Net/src/SocketImpl.cpp:272: Poco::Net::SocketImpl::shutdown() @ 0x00000000228a5532 9. /build/base/poco/Net/src/StreamSocket.cpp:109: Poco::Net::StreamSocket::shutdown() @ 0x00000000228a925e 10. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:1032: Coordination::ZooKeeper::finalize(bool, bool, String const&) @ 0x000000001e23e4e9 11. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:795: Coordination::ZooKeeper::receiveThread() @ 0x000000001e2475df 12. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:398: Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_1::operator()() const @ 0x000000001e24d698 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001e24d675 14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_1&, std::tuple<>&>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_1&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e24d659 15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_1&, std::tuple<>&>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_1&, std::tuple<>&) @ 0x000000001e24d5bd 16. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_1>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr)::$_1&&)::'lambda'()::operator()() @ 0x000000001e24d4e5 17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001e24d455 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001e24d435 19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001e24d415 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001e24d3e0 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 23. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 24. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 28. ? @ 0x00007f01847acac3 29. ? @ 0x00007f018483e850 (version 24.3.12.76.altinitystable) 2024.12.16 12:10:23.998420 [ 16037 ] {} RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled 2024.12.16 12:10:24.559813 [ 15389 ] {} Application: Code: 695. DB::Exception: Load job 'load table test_1.wv' failed: Code: 1. DB::Exception: Experimental WINDOW VIEW feature is not supported with new infrastructure for query analysis (the setting 'allow_experimental_analyzer'): Cannot attach table `test_1`.`wv` from metadata file /var/lib/clickhouse/store/a78/a7828c9b-5200-481c-ac66-4570598f91a1/wv.sql from query ATTACH WINDOW VIEW test_1.wv UUID 'a2de7aa9-7124-4016-995e-d12992706b6f' TO test_1.dst (`count` UInt64, `market` Int32, `w_end` DateTime('US/Samoa')) WATERMARK ASCENDING AS SELECT count(a) AS count, market, tumbleEnd(wid) AS w_end FROM test_1.mt GROUP BY tumble(timestamp, toIntervalSecond('5'), 'US/Samoa') AS wid, market. (UNSUPPORTED_METHOD), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f4eb7 6. /build/src/Storages/WindowView/StorageWindowView.cpp:1181: DB::StorageWindowView::StorageWindowView(DB::StorageID const&, std::shared_ptr, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel) @ 0x000000001d170c0d 7. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageWindowView* std::construct_at[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, DB::StorageWindowView*>(DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a5e3 8. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits>::construct[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void, void>(std::allocator&, DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a361 9. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace>::__shared_ptr_emplace[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&>(std::allocator, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d18a02d 10. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr std::allocate_shared[abi:v15000], DB::StorageID const&, std::shared_ptr, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(std::allocator const&, DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189e7a 11. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr std::make_shared[abi:v15000], DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(DB::StorageID const&, std::shared_ptr&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189e06 12. /build/src/Storages/WindowView/StorageWindowView.cpp:1693: DB::registerStorageWindowView(DB::StorageFactory&)::$_0::operator()(DB::StorageFactory::Arguments const&) const @ 0x000000001d17d7a6 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d17d61d 14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001d17d5bd 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d17d57d 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d17d545 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001c3709de 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001c36f2fd 19. /build/src/Storages/StorageFactory.cpp:224: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr, std::shared_ptr, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, DB::LoadingStrictnessLevel) const @ 0x000000001c36dc1d 20. /build/src/Databases/DatabaseOnDisk.cpp:120: DB::createTableFromAST(DB::ASTCreateQuery, String const&, String const&, std::shared_ptr, DB::LoadingStrictnessLevel) @ 0x000000001a0b0752 21. /build/src/Databases/DatabaseOrdinary.cpp:248: DB::DatabaseOrdinary::loadTableFromMetadata(std::shared_ptr, String const&, DB::QualifiedTableName const&, std::shared_ptr const&, DB::LoadingStrictnessLevel) @ 0x000000001a0d947b 22. /build/src/Databases/DatabaseOrdinary.cpp:283: DB::DatabaseOrdinary::loadTableFromMetadataAsync(DB::AsyncLoader&, std::unordered_set, std::hash>, std::equal_to>, std::allocator>>, std::shared_ptr, String const&, DB::QualifiedTableName const&, std::shared_ptr const&, DB::LoadingStrictnessLevel)::$_0::operator()(DB::AsyncLoader&, std::shared_ptr const&) const @ 0x000000001a0e0c63 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a0e0be5 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a0e0ba5 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a0e0b65 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a0e0b30 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000135ff446 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000135f5ac5 29. /build/src/Common/AsyncLoader.cpp:169: DB::LoadJob::execute(DB::AsyncLoader&, unsigned long, std::shared_ptr const&) @ 0x00000000135e790b 30. /build/src/Common/AsyncLoader.cpp:937: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f3f67 31. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock&)::$_1::operator()() const @ 0x00000000135f52dc (version 24.3.12.76.altinitystable). (ASYNC_LOAD_FAILED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f9382 1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f934d 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a068a0 3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132bb52e 4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eff2a 5. /build/src/Common/Exception.h:109: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String const&, String&&) @ 0x000000000b4fe4cc 6. /build/src/Common/AsyncLoader.cpp:942: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f415d 7. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock&)::$_1::operator()() const @ 0x00000000135f52dc 8. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000135f52b5 9. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000135f5295 10. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000135f5275 11. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000135f523d 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 14. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl>::worker(std::__list_iterator, void*>) @ 0x00000000133d9082 15. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133e2ec4 16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2e95 17. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e2e79 18. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e2d1d 19. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e2be5 20. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e2b55 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e2b35 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e2b15 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e2ae0 24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b441b6 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b43df5 26. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl::worker(std::__list_iterator) @ 0x00000000133d58b1 27. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x00000000133dd304 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dd2b5 29. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dd27d 30. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x00000000133dd082 31. ? @ 0x00007f01847acac3 (version 24.3.12.76.altinitystable)